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PREFACE 


This handbook provides COMOPTEVFOR with a reference source of 
measures of effectiveness (MOE's) used in Naval warfare and previous OPTEVFOR 
projects. In particular, this reference handbook provides assistance to 
Project Officers and Analysts in the preparation of a TEMP, Evaluation Plan 
or Test Plan, and as an aid: 


(1) in the selection of measures of effectiveness 

(2) in the corresponding selection of test objectives 

(3) in the identification of data requirements 

(4) in the conduct of project operations 

(5) in the determination of data analysis techniques to be used. 


The information presented in this handbook is based on a compre- 
hensive review of OPTEVFOR reports. Specifically, a summary is presented 
of MOE's used in Development Assists, Operational Assists, Operational 
Appraisals, Technical Evaluations, Operational Evaluations, Concurrent 
Evaluations, Fleet Research Investigations and Fleet Operational Investi- 
gations. For each report the platform, system or subsystem considered is 
briefiy described together with the specific test, evaluation, or appraisal 
objectives, the MOE's selected, ani the corresponding MOE data requirements. 


The scope of the handbook is limited to effectiveness measures 
only. Materiel reliability and human factor measures are not included. 
Even in the effectiveness measure area the coverage is not complete — it 
was not intended to be. It is expected that continuous update will be 
per formed. 


This handbook is FOR GUIDANCE ONLY and is not intended to be the 
only source of information to be used by Project Officers or Analysts in 
the selection of measures of effectiveness. 
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1.0 INTROOUCT ION 


COMOPTEVFOR personnel become involved in the preparation of project 
plans for a broad range of projects. In Operational Assists for which the 
purpose is to gather operational data in a "quick look” effort to aid in 
deciding whether a particular course of development is worthy of pursuit, 
the project plan is prepared jointly by COMOPTEVFOR and the Developing 
Agency, but the execution and reporting of the results is accomplished by 
COMOPTEVFOR. In Operational Appraisals relating to systems, equipment or 
components in fleet use which have not undergone operational evaluation 
and/or been recommended for service use, COMOPTEVFOR is responsible for the 
planning and prosecution of the project. In Operational Evaluations for 
which the purpose is to determine the ability of the system or equipment 
to meet operational performance requirements, COMOPTEVFOR prepares the 
project plan, arranges for Fleet support, prosecutes the project, and 
analyzes and reports the results. COMOPTEVFOR has similar project respon- 
sibilities for the operational phase of Concurrent Evaluations. 


In the preparation of these project plans the overall project 
objectives must be defined and then the specific objectives, including 
success criteria, must be identified. An integral part of the project plan 
for an evaluation will be the definition of the missions or operational roles 
of the platforms, systems, subsystems and equipments involved. The success 
criteria form the basis for determining whether or not the missions or opera- 
tional roles are successful as reflected in whether or not the specific 
objectives are met. To quantify this determination requires the use of 
numerical scores or statistical estimates. This:is the role played by the 
measure of effectiveness. It provides the quantification of how well the 
specific objectives are met such as how successful a platform is in accomplish- 
ing its mission or how successful a system, subsystem or piece of equipment is 
in performing its operational role as part of the mission. 


The selection of MOE's is an important step in this preparation 
for an evaluation. This is because MOE's enable the Project Officer or 
Analyst to assess whether or not, or how well, the specific test objectives 
(chosen to test or verify that desired operational or performance goals are 
met) are satisfied. This handbook is designed to aid the Project Officer or 
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Analyst in this selection process. It is not intended to be an all- 
inclusive, or exhaustive, compendium of MOE's such that the Project 
Officer or Analyst needs only turn to the right page and then select 
his MOE. With the present changes in the test and evaluation process, 
previously used MOE's may no longer be appropriate and, even though 
suggestive of the types of measures which could be used, are in many 
cases incomplete by today's standards. Not only is the situation 
dynamic, but it can be generally stated that "every project is different”. 
Consequently, this handbook is not a cookbook, but serves more for stimu- 
lation and guidance in general approaches to be followed. The selection 
of MOE's and the corresponding details must be tailored to the specific 
project. 

Figure 1.1 provides an illustration of the use of this handbook 
by a Project Officer or Analyst. Once the project objectives, the specific 
objectives for test and evaluation, the platforms involved and the level 
of evaluation are defined, the Project Officer or Analyst is at the MOE 
selection stage. There may be more than one MOE which could be used and, 
furthermore, for each objective or set of objectives there may be a different 
MOE which is applicable. The Project Officer or Analyst is thus faced with 
having to make this selection. It is at this MOE selection stage where a 
Measure: of Effectiveness Handbook can be of the greatest value. The reason 
for this is that such a handbook would contain a summary of MOE's by area(s) 
of applicability, criteria (based on test objective(s)) for selection when 
more than one choice of a MOE exists, formulations of each MOE, an identifi- 
cation of data requirements for computation, and a reference to previous 
usage of the MOE. Thus, such a document would provide ready access to infor- 
mation needed by the Project Officer and can also serve as a reference source 
for Analysts in the design of test plans and the evaluation of systems. 


Figures 1.2 and 1.3 provide illustrations in ASW of typical MOE's 


which could be used in platform level and system level evaluations, respectively. 


As can be seen, at the platform level there may be more than one mission for 
the platform, for a given mission there may be more than one success criterion, 
and for a given success criterion there may be more than one MOE. Similarly, 

for a specified system operational role within a platform mission there may be 
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more than one success criterion, and for a given success criterion there 
may also be more than one MOE. Each choice of the MOE could be expected 
to lead to a special set of data requirements. The project plan would 
thus have to include these data requirements and the project data sheets 
would have to be structured according to these requirements. The analysis 
required to compute these MOE's would be dependent upon the complexity of 
the MOE formulation and could even require the use of a digital computer 
for not only data processing and reduction but perhaps to perform mathe- 
matical simulations of portiuns of the test which could not be conducted 
at sea. 


It is important to recognize that in the selection of an MOE one 
must consider the tasks that the platform, system, subsystem or equipment 
under evaluation has to perform. Measures of effectiveness can also be 
regarded as measures of how well these tasks are done. For example, in 
evaluating the detection performance of a sensor, the MOE may be the prob- 
ability of detection as a function of target range, or in evaluating the 
kill performance of a missile warhead the MOE may be the probability of 
target kill given detonation. In many cases more than one task (say, sub- 
task) comprise a broader task such as to achieve overall target kill it 
must be detected, recognized as a valid target, acquired, tracked, fired 
at with a weapon and killed. An MOE for each of these subtasks is commonly 
referred to as a "function MOE" since it provides a measure of how well the 
individual subtask (or function necessary to accomplish the broader task) is 
accomplished. Therefore, an MOE for the broader task could be expected to 
be a function of these sudtask or function MOE's. This illustrates the type 
of hierarchy which generally exists among MOE's. 


As the MOE hierarchy evolves from the top Jevel to the lower levels 
(such as from force level to platform level to system level to subsystem or 
equipment level), the nature or form of the MOE changes. At the lower levels, 
the MOE's become less “effectiveness oriented" and more "performance oriented". 
For example, median detection rarge, circular error probable, mean miss 
distance, etc. are typical performance oriented MOE's, whereas expected number 
of target kills per sortie, probability of target detection, classification, 
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localization and kill, and the exchange ratio given by the ratio of enewy 
kills to friendly kills are typical effectiveness oriented MOE's at the 
platform or force levels. It is important to emphasize that the selection 
of MOE's and data requirements ἰ5 not a bottom-up procedure but rather a 
top-down procedure; that is, a Project Officer or Analyst should not first 
look up MOE's to see what he cen calculate and then let this drive the tests 
that are to be run. He should focus his MOE selection effort at least one 
evaluation level higher than that called for in the test or evaluation, and 
select an effectiveness oriented MOE before determining the performance 
oriented MOE's which it depends upon. 


In the following sections are presented discussions of how MOE's 
are used in OPTEVFOR projects and analyses, guidance in the selection of 
these MOE's, the hierarchy that exists between MOE's at various levels of 
evaluation, MOE data formulations, and how to use the MOE data base provided 
in Appendix 8 of this handbook. This data base is intended to be illustrative 
of the types of MOE's that have been used in the past and are thus potential 
candidates for use now or in the future, however the Project Officer or 
Analyst should be aware of the caveat, namely, what was used in the past 
(be it right or wrong) is not necessarily what should be used now or in 
the future. The Project Officer or Analyst should use this data base as a 
starting point not as an ending point in the selection of the MOE's most 
appropriate for his particular test or evaluation. As new MOE's are created 
and formulated, they can be readily added to the data base, thus providing 
an up to date MOE reference source. 


2.0 GUIDELINES AND CRITERIA FOR MOE SELECTION 


The importance of choosing the right MOE is illustrated by a 
classic example offered by Morse and Kimba11. | During World War II, 
British merchant ships in the Mediterranean were provided with anti- 
aircraft guns to protect them against German dive bombers. After several 
months of operation, an effectiveness evaluation was made which showed 
that the enemy aircraft was shot down in only about four percent of the 


philip M. Morse and George £. Kimball, Methods of Operations Research, 
John Wiley and Sons, New York, 195] 
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attacks. On this basis, it was tentatively decided to remove the guns, 
which were relatively expensive and needed elsewhere. It was then pointed 
out that the wrong M0E had been used in the evaluation. The real objective 
was to protect the merchant vessels, not necessarily to destroy enemy 
aircraft, which could be done more efficiently in other ways. If the guns 
caused the aircraft to stay at high altitude or forced them to maneuver 
evasively, thus degrading the bombing accuracy, they would have served 
their purpose. When the MOE was framed in terms of the proper objective, 
it was found that only ten percent of the protected ships had been sunk 
when attacked, compared with twenty-five percent for the unprotected 
ships. Based on these facts, the guns were left on the ships. 


A similar type of situation occurred more recently in the Viet 
Nam War when the SHRIKE antiradiation missile was introduced. This missile 
was designed to home-on and to destroy radars. When it was first used, 
the missile was very successful in destroying radars; however, the enemy 
soon learned that by shutting off or intermittently using their radars 
they could defeat the missile. Consequently, choosing the missile MOE 


as the probability of radar kill, we have a case where the initially observed 


values of this MOE were high, but decreased with time and continued use of 


the missile. The problem here is one of choosing the wrong MOE. In reality, 


the purpose of the missile was to increase the survivability of penetrating 
strike aircraft by suppressing enemy radar transmissions or causing the 
enemy radars to cease radiating; hence no surface-to-air missiles could 

be fired. This objective can be accomplished in several ways, namely: 


(1) the missile can physically destroy the radar as it is designed 


to do; 


(2) the missile can be fired at the radar target, and if the radar 


operator is aware that the missile has been launched at him, 
he may shut the radar off the air rather than risk being 
destroyed; 

(3) the mission can be accomplished if the pilot turns the air- 
craft carrying the antiradiation missile toward the target, 
preparing for or feigning a missile launch, and then the 
radar operator, anticipating a missile attack, shuts down. 
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Consequently, the mission objective can be accomplished without firing any 
missiles at all. In the case of strike warfare where the antiradiation 
missile is employed to protect penetrating aircraft, a candidate measure of 
effectiveness would be the probability that either no surface-to-air missiles 
are fired or, given that at least one SAM is fired, all aircraft survive. 


In addition to showing that a completely wrong decision can be 
forced by an injudicious choice of criterion, the above examples serve to 
illustrate an important principle of criteria selection: the criteria must 


reflect the user's objectives at the appropriate level of generality. A 


further observation regarding these two examples is that depending on 
whether or not your choice is the offensive or defensive role, the corre- 


sponding MOE's are different. 


Basic guidance in the selection of an MOE and success criteria for 


the evaluation of a platform, system, subsystem or piece of equipment can 


generally be found by referring to the principal documents in the RDT&E 
Planning and Acquisition Process — specifically, GOR's, TSOR's, PTA's, SOR's 
and TDP's for on-going programs, and CPPG's, CPAM's, STO's, OR's, TLR's and 
TLS's for new and future programs. 


General Operational Requirements (GOR's) forecast operational 
capability requirements, Tentative Specific Operational Requirements (TSOR's) 
identify specific operational needs and the required capabilities to satisfy 
those needs, Proposed Technical Approaches (PTA's) specify alternative 
approaches to attain the stated needs, Specific Operational Requirements (SOR's) 
formally state the need for development of new or improved capabilities, and 
Technical Development Plans (TDP's) document the actions, procedures and 
resources required to achieve the capability stated in the SOR's. For 
example, GOR-11 Air Strike Warfare states that in assessing capability to 
perform the Defense Suppression Mission one must recognize thac the objec- 
tive is to help minimize overall strike force attrition by using escorts to 
protect against surface and airborne defenses; hence, in this case, the 
success criterion is based on the requirement that the defenses do not 
fire, or are relatively ineffective in their fire, during the attack by 
the primary strike force and thus suppression is successful if the enemy 
defensive systems are unable to effectively impede the primary mission. 
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The corresponding SOR's and TDP's then address the specific types of 
weapon systems and development plans, respectively, in order to meet fore- 
casted operational capability requirements for the performance of this 
mission against future anticipated threats. 


In the case of many new and all future programs, potential sources 
of information on missions, operational roles, success and performance 
criteria, and test objectives are of various types. The CNO Planning 
Programming Guidance (CPPG) document describes Navy roles and missions, 
and furnishes broad Navy planning guidance. CNO Program Analysis Memoranda 
(CPAM) treat mission and support areas in terms of cost and capabilities, 
and furnish the basis for consideration of broad program alternatives. 
Science and Technology Objectives (STO's), as part of the Research and 
Development Plan, describe in broad terms the Navy role and objectives 
anticipated in the particular warfare area in the 10-20 year future time 
frame, and describe the threat that the Navy anticipates encountering 
together with the needed capabilities to neutralize or overcome this threat 
in this time frame. Operational Requirements (OR's) have the purpose of 
establishing the parameters for the concept or system envisioned and contain 
the following: a brief concise statement of opposition forces, time frame 
and the expected parameters of the threat or threat system; performance 
criteria; performance goals for the intended mission; statement of an 
achievable level of performance below which the development will not be 
acceptable; description of the natural and opposition environment; statement 
of where, how and under what environmental conditions the capability will 
be employed. The Top Level Requirements (TLR) document is basically a ship 
acquisition document which establishes a requirements-capability baseline 
and describes the combat tasks and functions the ship is intended to perform 
in the defined mission areas. The Top Level Specifications (TLS) document 
translates the TLR document into a physical ship description. 


Once the overall project and specific objectives have been defined, 
the types of platforms, systems, subsystems and equipments to be evaluated 
or appraised must be identified, the level of evaluation (such as platform, 
system or subsystem) defined, and the operational situations for evaluation 
or appraisal described. For example, the warfare area of interest might be 
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Airborne ASW and the operational situation that of contact investigation at 
the system level using a helicopter platform equipped with dipping sonar 
and torpedoes. At this point in the project plan preparation process, a 
decision must be made as to what measures of effectiveness should be employed. 
In this example, some of the choices are: (1) detection sweep width (in nm.) 
at a prescribed probability of detection, (2) probability of classification 
given detection, (3) probability of localization given classification and 
detection, and (4) probability of target kill given localization. The 
Project Officer is thus confronted with having to make a choice from amongst 
one or more possibilities, each of which may appear to be equally as good 

as any other. If the specific objective is assessment of detection 
capability, then (1) is most appropriate, whereas for the specific 
objectives of classification, localization and kill measures (2), (3) 

and (4) are the most appropriate, respectively. A further consideration 

is that each MOE would typically have its own special data requirements 

and data formulation. 


Tables 2.1 — 2.3 provide a further illustration of the fact that 
for a given specific objective there generally exists more than one choice 
of an MOE, each with its own special data requirements and formulation, 
for the case of communications systems, ECM systems, and radar systems, 
respectively. 


Generally, the choice of an MOE to be used in the evaluation of 
any platform, system, subsystem or piece of equipment must meet basic 
requirements such as: 


(1) It must directly relate to how well the specific objective 
ts met. 

(2) It should be relevant to the mission or operational role of 
interest. 

(3) It should be precisely defined and expressed in terms meaning- 
ful to the decision maker in order to prevent decision makers 
and others from misunderstanding the implications of the MOE. 

(4) It must be capable of exact quantitative definition in terms 
of inputs that are measurable. If the inputs are not measure- 
able, the MOE cannot be evaluated. 
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(5) It must be feasible to measure or calculate. 

(6) It should have exhaustive inputs and be sensitive to all 
variables and factors affecting the item (i.e., platform, 
system, subsystem or equipment). By this it is meant that 
anything that affects the item's effectiveness should appear 
as an input to the MOE in some fashion. This assures that all 
aspects that can affect the item's effectiveness are included 
in the inputs. 

(7) It, as well as its inputs, should be mutually exclusive in 
the sense that no aspect should be "counted" more than once. 


A final comment is that it is nearly impossible to compare a new 
system with an old one when different MOE's are being used. When the quality 
of the data gathered is not changing rapidly, using standard MOE's for old 
and new systems will make it easier to compare them as long as the test 
conditions are the same. Making a comparison using the same MOE under 
differing test conditions can (and most probably would) lead to an invalid 
conclusion. 

3.0 MOE HIERARCHY APPROACH 


Measures of effectiveness vary in structure and in formulation 
according to the level of the evaluation desired. To illustrate this, 
consider the area of Naval gunfire support. Here measures of effective- 
ness may be broadly categorized into those applied to individual weapons, 
those used to compare two types of ships, and those computed for entire 
fire support forces in specific scenarios and special situations. At 
the lowest level are those that apply to a single tube of a gun battery 
or a single round, In this case, measures of effectiveness are the 
accuracy and range of the gun, its riring rate, and the expected number 
of rounds required to achieve some specified damage or casualty level 
to a particular type of target. A first higher level measure of effective- 
ness is the amount of time a battery must fire to achieve specified damage 
or casualty levels against a representative spectrum of targets at various 
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ranges. A second higher order measure of effectiveness is the percentage 
of a ship's ammunition of a given type that must be expended in order to 
accomplish the desired results against representative targets at various 
ranges. At a still higher level of sophistication are those measures of 
effectiveness which apply to the fire support force as a whole such as: 
live target time, which is the time interval from the occurrence of a 
target until some weapon system has fired the expected number of rounds 
required to achieve the required effects upon the target; target firing 
time, which is measured to the impact of the first fire-for-effect volley 
or salvo; the number of lost targets, that is, targets which have occurred? 
within the fire support system but which disappear before fire-for-effect 
commences, either because they displace and are lost to the observer or 
because they close with (or are closed by) landing force units and can 

no longer be attacked by the fire support system. 


Generally, there are four levels of effectiveness evaluation. 
These are 


(1) Force (platform mix) 
(2) Platform 

(3) System 

(4) Subsystem (or equipment) 


COMOPTEVFOR Project Officers and Analysts are normally only concerned with 
the selection of MOE's at the last tnree levels, that is, excluding force 
level evaluations. At the platform level the Project Officer's interest 
may be in how well a platform would perform in conducting a particular 
type of mission or conducting given tactics in the course of following 

a scenario. At this level the measure of effectiveness is sometimes 
referred to as a measure of operational effectiveness (MOOE), that is, a 
MOOE could be regarded as a measure of how well the Naval “unit” (such 

as ship, aircraft, submarine, etc.) performs its mission or operational 
roles. A related measure, called a measure of operational success (MOOS), 
is a measure which considers not only the "effectiveness" as determined 

by the MOOE but also the reliability and operational availability of the 
equipment, subsystems and systems involved. The MOOE for a platform jis 
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a function of the individual system MOE's where the platform is regarded 

as being comprised of a collection of systems. The systems then are 
comprised of subsystems and so system MOE's can be expected to be functions 
of subsystem MOE's. This relationship between MOE's at various levels of 
evaluation is what is referred to as the MOE chain or the hierarchy of 
MOE's. 


In the selection of an MOE the element being supported is critical. 
Since the object under evaluation either supports the next higher level in 
hierarchy or the next step in the evaluation process, the MOE selected should 


likewise be related to the next level or next step. The detection performance 


of a sonar or the kill capability of a torpedo should be evaluated in the 
context of the overall platform performance. This is why it is important to 
go to at least one higher level of evaluation in performing effectiveness 
evaluations. The MOOE is the effectiveness measure ἃ: the platform level 
whereas detection probability and kil] probability are input MOE's from the 
system level. In Appendix A are presented illustrative examples of typical 


MOOE's that are candidates for consideration in OPTEVFOR tests and evaluation. 


As the MOE hierarchy evolves from the top level (i.e., platiorm) 
to the lower levels, the nature or form of the MOE changes. At the lower 
levels the MOE's become less “effectiveness oriented" and more "perfor- 
mance oriented". For example, performance oriented MOE's are given by 
such quantities as detection range, tracking accuracy, and circular error 
probable (CEP), whereas the corresponding effectiveness oriented (or 
performance dependent) MOE's would be the probability of detection (a 
function of detection range), the probability of successful tracking 
(a function of tracking accuracy) and the probability of target kill (a 
function of weapon CEP). 


Furthermore, MOE's used in platform and system level evaluations 
are generally functions of what are called "function MOE's", that is, 
MOE's which relate to how well certain necessary functions are performed 
as part of the platform or system level evaluation. For example, in the 
attack of an airborne target by an air-to-air missile, in order to obtain 
target kill the functions of launch, guidance, fuzing and kill? must be 
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successfully accomplished. Figure 3.1 provides an illustration of this 
example showing how the MOE given by single shot kill probability depends 
on the corresponding function MOE's. 


It is important to note that at the function level the MOE 
depends on “other things being equal". For example, if other things 
are equal, an air-to-air missile with a guidance reliability of 0.95 
is clearly better than one with a guidance reliability of 0.80; however, 
this functional MOE comparison does not 161] us what this improvement 
in guidance reliability really means operationally. The missile with 
the higher guidance reliability may weigh more and thus the aircraft 
must carry fewer missiles on a sortie or it may be harder to maintain 
in an operational condition. Generally, a comparison between function 
MOE's is not as meaningful as a comparison at the next higher level of MOE's 
which depend upon these function MOE's. 


A further illustration of function MOE's and their relationship 
to the next higher lével MOE is provided in Figures 3.2 and 3.3. Referring 
to Figure 3.2, a platform level MOE {is given by SSK versus Transitor effec- 
tiveness for a submarine on a barrier mission with the specific objective of 
detecting and killing any enemy submarine encountered in the patrol area. 
In this case the functions necessary for the conduct of the mission are 
detection, classification, attack and kill. The effectiveness evaluation 
can be conducted at the platform level by measuring the number of transitors 
killed by the SSK and tne number of valid detection opportunities for the 
SSK, and then computing the ratio of these two quantities. On the other 
hand, depending on the circumstances of the test and the available data 
samples, the individual function MOE's could be estimated as shown and then 
multiplied to obtain an estimate of the next higher level MOE. Figure 3.3 
provides a more detailed example of this point involving two sub-levels 
(function and sub-function) in the MOE development and formulation for the 
case of an ASW helicopter which is attempting to localize and attack a 
submarine target. 


As can be seen from these two examples, tne determination of data 
requirements for MOE computation depends upon the level of evaluation being 
performed. This is because the lower level MOE's are more readily evaluated, 
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whereas the platform or system level MOE's, since they are functions of 
lower level MOE's, have more complex data requirements. The general 
approach to structuring data requirements is to start with the MOE (or 
MOE's) selected for evaluation purposes and to identify its formulation 
in terms of lower level MOE's. The next scep is to identify the formula- 
tion of each lower level MOE into further lower level MOE's until one 
reaches the level at which data can be readily collected. Figure 3.4 
provides an illustration of this process in terms of taking the function 
MOE's and identifying those performance parameters necessary to compute 
them. Furthermore, Figures 3.1—3.3 and 3.5 provide good illustrations 
of the complete decomposition of an MOE into lower level MOE's and their 
corresponding data requirements in addition to specifying where one might 
obtain the necessary data. 


In many cases when an MOE is expressed as a function of lower 
level MOE's, it is possible to collect data directly at each level in the 
hierarchy so as to compute either the top level MOE or any of its dependent 
Tower level MOE's. Such is the case illustrated in Figure 3.6 for detection- 
type MOE's. Generally accepted detection oriented MOE's are given by the 
average detection range and the probability of detection as a function of 
range. The latter can also be expressed as a function of target aspect 
and speed. There exists an intimate relationship between these MOE's as 
illustrated in Figure 3.6. The point to be made here is that at a particu- 
lar evaluation level where more than one choice of an MOE exists, some of 
these MOE's can be computed from one or more of the others. In a sense, 
this implies that not only does there exist a hierarchy of MOE's between 
levels of evaluation, but also there exists a hierarchy between MOE's at 
a specified level of evaluation. The decision as to what level the data 
should be collected depends upon such factors as available sample sizes, 
statistical confidence desired in the results obtained, and the complexity 
of the analysis involved. These factors would normally be an integral part 
of the project plan. 


In summary, key observations to be made relative to the MOE 
hierarchy and the selection of MOE's are as follows: 
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(1) MOE's for platforms, systems and subsystems depend on 
the intenaed use of these platforms, systems and subsystems. 

(2) Many times more than one MOE may be appropriate. 

(3) MOE's can be combined to form higher level MOE's or, 
conversely, MOE's can be expressed as functions of lower 
level MOE's. 

(4) Lower level MOE's are more readily measured because of 
data availability, consequently, to evaluate a higher 
level MOE one must know its relationship to the measurable 
lower level MOE's. 


4.0 USE OF THE HANDBOOK DATA BASE 


In order to establish a data base for use by Project Officers and 
Analysts in the selection of measures of effectiveness and the determination 
of the corresponding data requirements and MOE formulation, two types of 
MOE reviews were performed. 


First, a review of platform level types of MOE's, representative 
of MOOE's, was performed using the results of a previously conducted study* 
for the Office of Naval Research. These measures of effectiveness, the 
applicable missions or operational situations, the corresponding success 
criteria, and the types of systems or subsystems which could be evaluated 
using these MOOE's are presented in Appendix A. 


The second review consisted of an examination of previously com- 
pleted OT&E reports. This review covered Concurrent Evaluations of ship- 
board and airborne systems; Operational Appraisals for shipboard and 
combined systems or equipments; Operational Assists for shipboard, airborne 
and combined systems or equipments. The objective of this review was to 
document for reference purposes the types of systems and equipments whose 
test and evaluation involves the services of OPTEVFOR personnel. Not only 
were specific systems and equipments identified, but so were the specific 
test objectives, the measure(s) of effectiveness, the data requirements, 


* "A Study of Measures of Effectiveness Used In Naval Analysis Studies", 
Vols. 1-4, Ultrasystems, Inc., 31 Oct. 1972 
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data sources, and MOE formulation identified. An attempt was made, even 
though not including all such projects, to provide a representative sample 
of this type of information for OPTEVFOR projects. The results of this 
survey are presented in Table B-2 of Appendix B. 


In order to facilitate the use of this OT&E data base, MOE usage 
was categorized according to the platform, system, subsystem or equipment 
area. Twelve basic category areas were selected representing: Aircraft (A), 
Acoustic Detection ἃ Countermeasures (ADC), Communications (C), Data ἃ 
Display (DD), Electromagnetic Detection ἃ Countermeasures (EDC), Fire 
Control (FC), Infrared ἃ Optical Detection (100), Missiles (M), Navigation ἃ 
Guidance (NG), Ordnance (0), Submarines (5), and Surface Ships (SS). Within 
each area the MOE information from a project report was then separated 
according to the specific performance or evaluation objective for the plat- 
form, system, subsystem or equipment considered. As a result, this provided 
a "sorting out" of MOE's by type of item evaluated based on previous MOE 
usage in OPTEVFOR projects. 


The basic steps to be followed in the use of this OT&E data base 
by a Project Officer or Analyst can be described as follows: 


Step 1 Select the platform, system, subsystem or equipment of 
interest. 


Step 2 From the project objectives define the specific 
objective(s) of the evaluation. 


Step 3 Use the index of Table B-3 to determine whether or not 
there is information in the data base regarding the 
evaluation of the platform, system, subsystem or equip- 
ment of interest. 


Step 4 Under the assumption that information of the type 
desired is in the data base, turn to the appropriate 
data item(s). 


To illustrate these steps, suppose the Project Officer or Analyst 
is interested in evaluating an air-to-surface antiradiation missile to be 
launched from an aircraft. He is not interested in evaluating the performance 
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of the aircraft (i.e., the platform) per se nor jis he interested solely 
in evaluating the performance of a particular subsystem of the missile. 
His interest is with the missile itself. Thus, he desires to know what 
measures of effectiveness could be used for a system level evaluation 

of an air-to-surface missile — in particular, one whose intended target 
is a surface radar. Therefore, referring to Table B-3, he observes that 
under the listing for missiles, anti-radfation there is information in 
area code M2. Turning to page B-107 in Table B-2, for the specific 
objective of "killing" the radar, the MOE given is the single shot kill 
probability which is defined as the product of the launch, guidance and 
fuze reliabilities and the kill probability against the target given a 
reliable missile. The formulation is given for each of these reliability 
terms and the sources of data are specified. 


If the Project Officer or Analyst is interested in a platform 
level type of evaluation, specifically, how well a submarine performs in 
the Fixed Barrier Role, that is patrolling a particular area with the 
objective of detecting and killing any enemy submarine encountered, then 
referring to Table B-3 he observes that there are three items in the data 
base concerned with platform level evaluations of submarines, namely, in 
area code 51, items Sl-1, Sl-2 and 51-3. Turning to page B-139 in Table B-2, 
he observes that the information he seeks is given by data item SI-1. There 
the suggested MOE for this mission is given by SSK versus Transitor effective- 
ness, which would also correspond to a measure of operational effectiveness. 
The formulation of this MOE, the data requirements for its computation and 
an explanation cf the data sources are provided. Should he desire to read 
the report from which this information was obtained, the reference is given 
and, for ease of comparison and reading, the original notation as used in 
the report has been preserved. 


If the Project Officer or Analyst was in reality only interested 
in evaluating the performance of the submarine sonar in this barrier mission, 
then merely selecting a system level type of MOE for the sonar would not 
suffice nor would he obtain as a result a realistic assessment of how this 
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sonar supports the performance of the platform. For example, data item 
ADC1-1 (see page B-12) contains MOE's which could be used for submarine 
sonar evaluation, such as average detection range, figure-of-merit, 90% 
probability of detection range and the cumulative probability of detection 
as a function of range. These MOE's in themselves say nothing about the 
submarine performance in this mission. How good the sonar is should be 
evaluated in light of what contribution it makes to overall submarine 
performance, that is, we need to examine the next higher level of effective- 
ness, given in this case by the MOOE called SSK versus Transitor effectiveness. 
The first term, Pos in the formulation of this measure, given by the proba- 
bility that the SSK detects a transiting submarine without first being killed, 
given a detection opportunity, and the second term, Pos in the formulation 

of this measure, given by the probability that the SSK correctly classifies 

a transiting submarine without being killed between the time of detection and 
time of classification, given that the transitor has been detected, also 

could be regarded as submarine sonar MOE's. In particular, these are 

function MOE's representing how well the functions of detection and classi- 
fication are performed, respectively. By computing this MOOE, one can 
evaluate the contribution of the submarine sonar in performing both of these 
functions to the overall performance of the submarine in the barrier role. 


A possible result of Step 3 may be that for the evaluation level 
and platform, system, subsystem or equipment combination of interest there 
is no information of the type desired in the data base. The data base is 
not intended to be all-inclusive, thus exceptions will occur. However, it 
may be possible that upon reviewing available information for similar 
systems and equipments at perhaps a different Jevel of evaluation the Project 
Officer (or Analyst) may be able to obtain guidance as to the MOE's which 
he could consider. For example, most MOE's for sonobuoys could be used 
as MOE's for sonars, or MOE's for missiles are in many cases independent 
of whether or not they are air-to-air, air-to-surface, surface-to-surface 
or surface-to-air missiles. In any case, the data base is designed to be 
a starting point in the selection of MOE's to be used in OT&E projects not 
as an ending point. 
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APPENDIX A 
MEASURES OF OPERATIANAL, 


EFFECTIVENESS FOR SELECTED 
NAVAL PLATFORMS 
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APPENDIX B 


MEASURES OF EFFECTIVENESS 
HANDBOOK DATA BASE 
DERIVED FROM OT&E PROJECTS 


TABLE 8.1] OT&E Project Areas 


CODE AREA 
A Aircraft 
ADC Acoustic Detection & Countermeasures 
C Communications 
0D Data & Display 
EDC Electromagnetic Detection & Countermeasures 
FC Fire Contro] 
| 100 Infrared & Optical Detection 
M Missiles 
: NG Navigation & Guidance 
i 0 Ordnance 
᾿ 5 Submarines 
55 Surface Ships 


a 
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Area: 


TABILE B-2 Operational Test ἃ Evaluation 
MOE Data Base 


Aircraft (A 

CODE ITEM 

Al Attack Aircraft (F8U-2) 
A2 ASW Aircraft (S-2G) 

A3 Fleet Defense Aircraft 
A4 ASW Helicopter 

A4-] SH-3A 

A4-2 SH-3H 

A4-3 DASH 
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Al 


AIRCRAFT (A 


Al - Attack Aircraft 
DESCRIPTION: This is a carrier based airplane designed for a primary mission 
of a day or night visual fighter. 
(1) SPECIFIC OBJECTIVE: Evaluate the capability of the airplane to intercept 
approaching targets while under ground controlled intercept. 
MOE = Average kill distance, which is defined as the distance 
from CAP station to successful intercept of target 


REFERENCE: Final Report on Project OP/V264/VV 
“Evaluation of the F8U-2 Aircraft" 
21 March 1960, UNCL. 


A2 


ΑΖ - ASW Aircraft 


DESCRIPTION: This is a modified S-2E airplane with enhanced ASW capability. 
It contains passive directional sonobuoys, processing and display equipment, 
an acoustic data processor, tape recorder and sonobuoy receiver. 


(1) SPECIFIC OBJECTIVE: Evaluate submarine detection capability using 
sonobuoys. 


(MOE), = Mean time from initial sonobuoy drop to target initial 
line-of-bearing 
(MOE). = Mean range from sonobuoy to submarine at determination 
of initial DIFAR line-of -bearing 
(MOE), = Probability of obtaining an initial DIFAR line-of-bearing 
(ee of times initial rel 
« rline-of-bearing was obtained 
umber of detection attempts 
(2) SPECIFIC OBJECTIVE: Evaluate submarine locc‘ization capability using 
sonobuoys. 


(MOE), = Average time from the initial DIFAR line-of-bearing 
to the designation of the initial EP (estimated 
position) 
(MOE), = Mean EP error 
(MOE), = Mean OFX (DIFAR fix) error 
(MOE ) 4 = Circular error probable (CEP) about the mean EP 
(MOE). = Circular error probable (CEP) about the mean DFX 
(MOE). = Mean number of EP's generated prior to generation of a DFX 
(MOE), = Mean time from EP to designation of a OFX 
(MOE), = Mean time from initial contact to designation of a OFX 
(MOE), = Average number of sonobuoys required to generate a DFX 
(MOE), = Mean time from the designation of an actual DFX to active 
pattern completion 
(MOE) 14" Average number of DIFAR sonobuoys required to generate 
an initial EP 


Β-4 


A2 


ASSUMPTION: A DIFAR fix (DFX) is defined as that EP so designated by 
the flight crew; normally, the final EP prior to commencing active 


prosecution. 


REFERENCE: Final Report on Project P/V3 
"Conduct an Operational Appraisal of the S-2G Weapon System" 


11 Sept. 1972, SECRET 
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A3 - Fleet Defense Aircraft 


DESCRIPTION: This system is designed to provide a quick reaction, all- 
weather fleet defense capability against enemy surface-to-surface missile 
launch vessels. The aircraft is equipped with an air-to-surface missile 
system. ᾿ 
(1) SPECIFIC OBJECTIVE: Evaluate capability using airborne radar to 
aetect surface vessels. 
(MOE), = Probability of target detection as a function of aircraft 
altivude 
~ Number of detections 


Number of detection attempts 
(MOE). = Average detection range 
(2) SPECIFIC OBJECTIVE: Evaluate capability using airborne radar to acquire 
surface vessels. 
(MOE), = Probability of target acquisition given detection 
. Number of acquisitions 
umber of detections 
(MOE). = Average acquisition range 
(3) SPECIFIC OBJECTIVE: Evaluate capability using airborne radar to track 
surface vessels. 


MOE = Probability of maintaining radar target track up to 
missile firing as a function of aircraft altitude, 
target speed, sea state, attack angle and target aspect 
(amber of successful τη) 


= \tracking tests 
Number of radar tracking tests 


(4) SPECIFIC OBJECTIVE: Evaluate missile attack capability of surface 
vessels. 
MOE = Probability of successful missile-target intercept as 
a function of aircraft altitude, attack angle, launch 
range, sea state and target aspect 
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REFERENCE: 


A3 


Final Report on Project F/0255 
"Conduct a Fleet Operational Investigation of Guided Missile 


AIM-7E-2 (Sparrow) as an Antiship Missile" 
17 Oct. 1972, SECRET 
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A4 - ASW Helicopter 

| A4-1 

| DESCRIPTION: This is an ASW Helicopter Attack System (HATS) which is a 
standard SH-3A helicopter modified to incorporate multiple ASW sensors 

and display equipments. This system is designed to permit a single 
unassisted helicopter to localize and attack a high speed submarine. 

| (1) SPECIFIC OBJECTIVE: Evaluate localization and attack capability. 


MOE = Probability of successful localization and attack 
of a submarine for given localization method 


(ae of times localization and wel 
were successful 


δ: {πὐπρεγ of localization and autaes 
attempts 


(2) SPECIFIC OBJECTIVE: Evaluate localization capability. 


(MOE), = Probability of successful conversion of a sonar 
| contact to sonobuoys 
μοί of times conversion from a sonar ecueet 
= sto sonobuoys was successful 
! ( umber of sonar to sonobuoy eOnerexon 
attempts 
(MOE), = Probability of successful conversion of a sonar 
Ϊ contact to MAD 


[πε of times conversion from ἃ eer) 
= \contact to MAD was successful 


(hiner of sonar to MAD sein ial 


attempts 
Probability of successful conversion of a single 
buoy contact to a MAD contact 


(embe of times conversion from a single saa) 
contact to a MAD contact was successful 


ws (Huber of single buoy to MAO oe) 


attempts 


-ἃ 


a 


(MOE), 


(MOE), = Probability of successful conversion of a sonar 
contact to sonobuoys to a MAD contact 


(ansh of times conversion from a sonar eoneack) 

= ito sonobuoys to a MAD contact was successful 
(umber of sonar to sonobuoy to MAD conversion 
attempts 


A4 


REFERENCE: Final Report on Project F/0214 
"Fleet Operational Investigation of the ASW Helicopter Attack 
System (HATS)" 
3 March 1967, CONF. 


A4-2 
DESCRIPTION: This helicopter is designed to provide a multisensor, multi- 
mission capability. It has primary missions of ASW (antisubmarine warfare) 
and ASMO (anti-ship missile defense). 


(1) SPECIFIC OBJECTIVE: Evaluate self navigation capability. 


MOE = Circular error probable (CEP) of transit to datum navigation 
error as a function of range to datum 


(2) SPECIFIC OBJECTIVE: Evaluate sonobuoy drop accuracy. 


MOE = Circular error probable (CEP) of sonobuoy drop error as 
a function of pattern spacing 


(3) SPECIFIC OBJECTIVE: Evaluate passive acoustic localization capability 
using sonobuoys. 


(MOE), = Median time to establish an EP (esti. ced position) 
(MOE). = Mean time to establish an EP 

(MOE), = Median EP error 

(MOE) 4 * Mean EP error 

(MOE), « Probability of establishing an EP 


(eee of trials that resulted μὴ 

the establishment of an EP 

( umber of passive acoust ὃ 
localization trials 


(4) SPECIFIC OBJECTIVE: Evaluate initial attack capability. 


MOE = Probability of valid attack 


~ Number of valid attacks 
Number of attacks 


(5) SPECIFIC OBJECTIVE: Evaluate active datum redetection and attack 


capability. 


A4 


(MOE), = Probability of redetection 


« Number of valid redetections 
( umber of active datum redetect on) 
and attack trials 


(MOE) 4 = Probability of valid attack given redetection 


( Manoa of valid attacns) 
after redetection 


Ξ Number of valid redetections 


REFERENCE: Final Report on Project P/V4 
"Conduct an Operational Appraisal of the SH-3H Weapons System” 


2 Oct. 1973, SECRET 
A4-3 


DESCRIPTION: This is a drone ASW helicopter (DASH) which is designed to 
position an unmanned helicopter over a submarine contact, to drop homing 
torpedoes on the contact, and to return the drone to the ship under all 


weather conditions compatible with the operation of helicopters. 
(1) SPECIFIC OBJECTIVE: Determine weapon delivery capability. 


MOE = Median total attack error, which is defined as the 
distance between the weapon water entry position 
and the aimpoint based on the target's actual position, 
course and speed at time of weapon water entry. 


REFERENCE: Final Report on Project C/S18 FY6) 
“Evaluation of the DASH System Using the USS Hazelwood 


and DSN-1" 
7 Aug. 1961, CONF. 
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TABLE B-2 Operational Test & Evaluation 
MOE Data Base (Continued) 


Area: Acoustic Detection & Countermeasures (ADC 


ITEM 


Sonar 

Submarine Sonar (AN/BQR-16, AN/BQR-19) 
Towed Array Sonar (AN/BQR-15) 

Surface Ship Sonar (AN/SQQ-23) 


Mine Detection/Classification Sonar 
(AN/SQQ-14, AN/SQQ-16) 


Command Active Sonobuoy System (CASS) 
Sonobuoy (AN/SSQ-20, AN/SSQ-1) 


Submarine Classification and Tracking 
Device (SCAT) 


Electro-Acoustic Decoy (NIXIE) 
Acoustic Noisemaker (NAE Beacon Mk 3 
Mod 1) 


Acoustic Minesweeping Device 
(ROTOVAC 6X, ROTOVAC 7X) 


Acoustic Intercept Receiver (AN/WLR-9) 


Submarine Acoustic Warfare System 
(SAWS) 


B-1] 


AOC] 


ACOUSTIC DETECTION ἃ COUNTERMEASURES (ADC) 


ADC1 - Sonar 
ADC1l-1 Submarine sonar 


DESCRIPTION: This is a passive sonar system designed to provide sub- 
marines with a capability to passively detect and track surface targets. 


(1) SPECIFIC OBJECTIVE: Determine detection capability. 
(MOE), = Average detection range against surface ships 


(MOE). = Figure of merit 
= SL - NL + DI - RD 


where 

SL = target radiated noise level 

NL = background noise level 

OI = directivity index 

RD = recognition differential, which is defined as the 
signal-to-noise ratio at which the probability of 
detection is 50%. 
90% probability of detection range as a function 
of target relative bearing sector (fozward or 
hindsight), target type, target speed and iso- 
thermal layer depth 
Cumulative probability of detection as a function 


~~ 
ὥ 
[τ 
~ 
u 


(MOE), 


of range 


REFERENCES: (1) Final Report on Project C/S56 

"Conduct a Concurrent Evaluation of the AN/BQR-16 
HINDSIGHT Sonar" 

16 Feb. 1970, CONF. 

Final Report on Project C/S61 

"Conduct a Concurrent Evaluation of the AN/BQR-19 Sonar 
System" 

13 May 1970, SECRET 
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1-2 Towed Array Sonar 


DESCRIPTION: This is a low frequency, passive, towed array sonar which 
1s designed to detect surface vessels and submerged submarines including 
high performance nuclear submarines. 


(1) SPECIFIC OBJECTIVE: Determine detection performance. 


(MOE), = Probability of detection as a function of range 
for given target relative bearing sector (bow, 
beam, stern), target depth in relation to isothermal 
layer bcundary (layer separation, no layer separa- 
tion), target speed, target type, and own ship speed 


Number of detections 
umber of opportunities 


4 

J 

J 

J 

J 

J 

J (MOE), = 50% detection range, which is defined as the range 
] to target at which the cumulative probability of 

. detection is 50% 

(MOE), = Figure of merit, given target relative bearing 
Ϊ sector, line spectrum, target speed, and target type 
I 
J 
| 
J 
J 
J 
Ϊ 
Ϊ 


SL - NL + DI - RD 


where 
SL = target radiated noise level 


NL = background noise level 
DI = directivity index 
RD = recognition differential 


(2) SPECIFIC OBJECTIVE: Evaluate classification capability. 


(MOE), = Probability of a correct classification as a 
function ot target speed, target type, and 
target relative bearing sector 


« Nunoer of correct classifications 
er of classifications made 


(MOE), # Average time to classify after making a detection 


REFERENCE: Final Report on Project C/S59 
“Conduct a Concurrent Evaluation of the AN/BQR-15 Sonar System" 
26 June 1970, SECRET 
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ADC1-3 Surface ship sonar 


DESCRIPTION: This is a computer coordinated, high powered, simultaneous 
active/passive sonar system which utilizes the direct propagation path. 
The major features of the sonar are a simultaneous search while tracking 
capability, digital computer control and signal processing, and semi- 
automatic performance monitoring and fault localization. 


(1) SPECIFIC OBJECTIVE: Determine detection performance against submarine 
targets. 


(MOE), = Range for 50% cumulative probability of detection 
for given target characteristics (in-layer or 
below-layer, deep water or shallow water, aspect 
angle) 

(MOE), = Probability of target detection 
Number of detections 


" Number of opportunities 
(MOE), = Mean detection range 
(MOE), = Cumulative probability of detection versus range 
for given target characteristics (in-layer or 
below-layer, deep water or shallow water, aspect 
angle, mean wind velocity, mean sea state, mean 
target depth (keel) and mean layer depth) 


(2) SPECIFIC OBJECTIVE: Determine classification performance. 


(MOE), = Probability of correct classification 


~ Number οὗ correct classifications 
mber Of Classification events 


(MOE), = Probability of classifying a submarine as a 
submarine 


epee of times submarine target “ἢ 
~ «classified ἃς submarine 
(Tusber of classification events in) 
which sonar target was submarine 


(MOE), = Probability of classifying a non-submarine as a 
submarine 


(Sumer of times non-submarinse. target =) 
classified as submarine 


ἕ (Humber of classification events In which) 
sonar target was non-submarine 
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(MOE), = Probability of classifying a submarine as non- 
submarine 


Number of times submarine target ne 
. classified as_non-submarine 
(Nusber of classification events in which 
sonar target was submarine 


(MOE), = Probability of an incorrect classification 
occurring 


. Number of incorrect classifications 
umber of classification events 


(MOE) = Probability of an undetermined classification 
Number of times submarine targets and =) 


(sutmarne targets were unclassified 
3 (undetermined 
umber of classification events 


(MOE). = Probability of a sonar target submarine - 
classified as submarine event occurring 


(ee of times sonar target submarine ᾿ 
. ἀο]δοοί θα as submarine event occurred 
umber of classification events 


(MOE). = Probability of a sonar target submarine - 
classified as non-submarine event occurring 


(heer of times sonar target submarine - ) 
classified as nor-submarine event occurred 
er of classification events 


(MOE), = Probability of a sonar target non-submarine - 
classified as submarine event occurring 


(hunter of times sonar target non-submarine Ἵ 
classified as submarine event occurred 
r of classification events 
(MOE) 15 = Probability of a sonar target non-submarine - 
classified as non-submarine event occurring 


(fueees of times sonar target non-submarine Ἵ 
classified ἃς non-submarine event occurred 
umber of classification events 


(MOE), , = Probability of a sonar target submarine - 
unclassified event occurring 


μων of times sonar target submarine - 
unclassified event occurred ) 
r of classification events 
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(MOE), » = Probability of sonar target non-submarine - 
unclassified event occurring 


(hae of times sonar target asl in iad 
unclassified event occurred 


" “Number of classification events 
(MOE),. = Probability of a missed opportunity 
13 


Number of times sonar target submarine - 
classified as non-submarine events or 
sonar target submarine - unclassified 
events occurred 


Ρ (tuaber of classification events tn which) 
sonar target was submarine 
(MOE), 4 = Clue availability, which is defined as the 
probability of a clue being present 
« Number of times clue used 


Number of classifications made 

(MOE). = Clue reliability, which is defined as the prob- 
ability of a correct classification when the 
clue was used 
(ieee of correct classifications when oe) 


« clue was used 
“Number of times clue was οὖὦὮὮἢὮἢἪ͵ἪἩ. ΠΛ, 
(MOE). 6 = Clue effectiveness, which is defined as the 
probability that the clue was present and a 
correct classification occurred 


(ener of correct classifications ὙΠ8Π) 
the clue was used 


" “Number of classifications made 
(MOE), 7 = False alarm rate, which is defined as the mean 
time between false alarms 


. lotal time of detection exercise 
( umber of sonar target non-submarine Ἵ 
classified as submarine events 
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ASSUMPTIONS: 


(1) 


(2) 


(3) 


(4) 


Classification events consist of six possible types, 
namely, either submarine or non-submarine targets and 
then for each type of target it is either unclassified, 
classified as submarine cr classified as non-submarine. 
The operator correlates active and passive detections 
of the same target in making a classification. 

The event counted was the final classification that 
occurred in time, regardless if it was entered ona 
passive or active track. This was done in order to 
avoid double classification on the same target and 
assumed that the operator utilized all available 
information. 

Typical clues are TCD (target center display) echo 
length, echo intensity, echo quality, echo consistency 
and echo smoothness. 


(3) SPECIFIC OBJECTIVE: Determine tracking capability by mode of operation 
(alerted or non-alerted). 
(MOE), = Mean percent range error for given tracking 


interval (target range interval ) 


(MOE). = Mean bearing error (deg) for given tracking 


interval (target range interval) 


(MOE), = Mean in-range error (yds) for given tracking 


interval (target range interval) 


(MOE), = Mean cross-range error (yds) for given tracking 


interval (target range interval) 


(MOE), = Mean tracking radial error (yds) 


(MOE). = Radial probable error of observed target position 


ASSUMPTIONS: 
(1) For the purposes of analysis, the true target position 


was assumed to be a predicted target position obtained 
from a linear least square process using a moving 
sequence of the latest ten tracking observations. 


AOC] 


(2) The track quality vector (Q-number) is an estimate 
of the difference error in position between the true 
target position and the sonar measured position. 

(3) Radial probable error is the radius of the circle 
around the superimposed or mean prediction range 
positions in a range interval or moving interval such 
that 50% of the Q-vectors terminate inside the circle. 


| REFERENCE: First Partial Report on Project P/S1 (Phase 1) 
"Conduct an Operational Appraisal of the AN/SQQ-23 Sonar System" 
| 19 Aug. 1971, CONF. 


ADC1-4 Mine Detection/Classification Sonar 

DESCRIPTION: This is a sonar system whose purpose is to detect and classify 
mine-like objects. 

(1) SPECIFIC OBJECTIVE: Determine mine detection capability’. 


(MOE), = Probability of mine detection 
. Number of mine detections 


Number of detection opportunities 
(MOE), = Probability of mine detection versus range 
(et of mine detections ὑπ᾿ 


rs Ξ given range band 
( umber of detection opportunit #3) 


within given range band 


Ϊ (MOE), = Mean initial detection range 

ὃ (MOE), = Detection probability of mines as a function of 
Ϊ Pach path width (or lateral range from ship's 
trac 


Number of mine detections within specified search 


ἶ { path width 
. ( umber of mines within specified search path ) 


width 


(MOE), « Average slant range at which bottom objects were 
detected 
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(MOE ) = Average number of objects detected per run 
.« Number of objects detected 
umber of va runs 
(MOE). = Percent of mines and minelike objects detected 


" ΤΡ of mines and minelike objects detected , 100 
( urber of detection opportunities for mines ) 


and minelike objects 


(MOE), = Percent of mines detected 


« —Numbei*_of anes detected X 100 
umber of detection opportunities for mines 


(MOE), = Percent of total detections which were mines 


« Number of mines detected χ 100 
( er of detection opportunities for mines) 


and minelike objects 


ASSUMPTION: Criterion used for detection was: illumination of a 

bottom object by the sonar, recognition of this illumination on the 

search indicator PPI scope by the operator, and the determination and 
marking of the range and bearing of the illuminated object. 


(2) SPECIFIC OBJECTIVE: Evaluate mine classification capability. 


(MOE), = Average slant range at which contacts were classi- 
ied, i.e., the slant range at which a contact, 
which has been detected and transferred to the 
classify indicator B-scope, is initially classified 


(MOE), = Probability of correct classification of mines 


(event of correct classifications of mines as ) 


Z minelike 
ΓΤ of classification attempts on mines ) 


(including regained contacts) 


(MOE) = Percent correct classifications of minelike non- 
3 mine objects as non-mine 


(eer of correct classifications of oer) 

-\Minelike objects 

(Rater of classification attempts on non- ) 
minelike objects (including regained contacts) 


X 100 
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(MOE), = Percent detections classified 


Number of classifications made at least once χ 100 
rma of mines and minelike objects detected 


(MOE). = Percent correct classifications at least once 


Number of classifications correct at least once χ 100 
umber of classifications made at least once 


(MOE). = Percent detection opportunities detected, classified 
and classified correctly at least once 


=« Number of classifications correct at least once , 100 

hes pace Ui setae on opportunities for mines and ) 
(MOE), = Mean time required to classify a mine as minelike after 

gaining initial contact 

REFERENCES: (1) Final Report on Project C/Si2 FY 61 

"Concurrent Evaluation of the AN/SQQ-14 Mine Classifying/ 

Detecting Set" 

3 Dec. 1962, CONF. 

Final Report on Project 0/S153 

"Conduct an Operational Evaluation of the Mine Detection/ 

Classification Sonar Set AN/SQQ-16" 

4 Aug. 1970, CONF. 
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ADC2 - Command Active Sonobuoy System (CASS) 


DESCRIPTION: This system consists of sonobuoys, a command signal generator 
and a signal data processor which operates in conjunction with the sonobuow 
receivers. The sonobuoys are radio controlled and launched from an airplane 
to detect, locate, track and classify underwater targets. This system is 
designed to provide the airplane with a command-active sonar capability. 


(1) SPECIFIC OBJECTIVE: Evaluate the detection capability of the system 
against submarines. 
(MOE), = Cumulative percentage of contacts as a function 
of range and pulse mode 
(MOE). = Mean maximum contact range 


ASSUMPTIONS : 
(1) Contact percentage is the ratio of the number of trials 


in which target contact is gained to the total number 

of trials conducted for a given set of test variables. 
(2) Contact range is the range at which contact was lost 

on an outbound transit and gained on an inbound transit. 


(2) SPECIFIC OBJECTIVE: Evaluate the capability of the aircraft to con- 
vert from passive DIFAR fixing to a CASS detection. 


MOE = Probability of conversion to at least one valid 
echo as a function of DIFAR fix error 
~ Number _of successful conversions 
Number of conversion attempts 
(3) SPECIFIC OBJECTIVE: Evaluate CASS/MAD localization capability. 


MOE = Localization success percentage 


(Smee of times Neca ee etoN) 
is successful 


" “Number of localization attempts * 90 
(4) SPECIFIC OBJECTIVE: Evaluate the capability of the airplane to reattack 
submarine contacts. 
MOE = Percent successful reattacks, culled the reattack 
success rate 


. Number of successful reattacks 100 
umber of reattack attempts  * 
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(5) SPECIFIC OBJECTIVE: Evaluate active tracking capability. 


(MOE), = Percent contact time on at least one buoy as a 
function of range and sea state 
[0] contact time on at pease) 


= sone buoy 
otal opportunity time x 100 


(MOE). = Percent contact time on at least two buoys as a 
function of range and sea state 
{Π 6] contact time on at east) 


= .two_buoys 
“Yotal a ἘΣΤΙ ty tine SCS Ἰ00 


ASSUMPTION; The time during which the submarine is within sono- 
buoy range is the opportunity time. 


(6) SPECIFIC OBJECTIVE: Evaluate classification capability. 
(MOE), = Valid contact percentage as a function of pulse 
mode 
« Number of valid contacts reported, 100 
otal contacts reporte 
(MOE), = False contact percentage as a function of 
pulse mode 


~ Number of false contacts reported x 100 
otal contacts report 
REFERENCE: First Partial Report of Phase II on Project 0/V84 
"Conduct an Operational Evaluation of the Command Active 


Sonobuoy System (CASS)" 
30 August 1971, CONF. 
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ADC3 - Sonobuoy 
DESCRIPTION: This sonobuoy is designed for launching from ASW aircraft 
for the purpose of detecting and tracking submerged cavitating submarines. 


(1) SPECIFIC OBJECTIVE: Determine bearing accuracy. 


(MOE), = Average bearing error 
(MOE), « Average bearing error as a function of target azimuth 


(2) SPECIFIC OBJECTIVE: Evaluate detection capability. 


(MOE), « Average maximum detection and tracking range as a 
function of aspect (bow or stern) 
(MOE), = Average maximum detection range 
(MOE), = Percentage detections versus range for given target 
aspect 
(3) SPECIFIC OBJECTIVE: Evaluate sonobuoy reception capability. 


MOE = Average maximum radio frequency (RF) range as a function 
of type of approach (inbound or outbound) 


ASSUMPTIONS: 

(1) The maximum outbound range is that range at which either the 
compass signal or the audio signal is lost. 

(2) The maximum inbound range is that range at which both compass 
and audio signals are regained. 


(4) SPECIFIC OBJECTIVE: Evaluate sonobuoy classification capability. 
MOE = Percentage classifications versus range for given target 
aspect 
(5) SPECIFIC OBJECTIVE: Evaluate sonobuoy capability to fix the position 
of a submarine. 


MOE = Average radial fix error as a function of range and angle 


(6) SPECIFIC OBJECTIVE: Evaluate capability to convert sonobuoy bearings 
to MAD detections. 
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MOE = Percent MAD conversions 


~ Number of MAD marks 
” Number of runs x 100 


REFERENCES: (1) Final Report on Project OP/V218/J15-11 


(2 


(3 
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"Tactical Evaluation of the AN/SSQ-20 Passive Directional 
Sonobuoy in ASW Operations" 

25 Nov. 1960, CONF. 

Final Report on Project 0/V42 FY64 

“Conduct an Operational Evaluation of the AN/SSQ-1 
Directional Listening Sonobuoy" 

5 Oct. 1964, SECRET 

Supplementary Report on Project C/V2 FY61 

"Lofar Detection and Classification Capability Against USS 
Nautilus (SSN-571)" 

8 Feb. 1963, SECRET 
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ADC4 - Submarine Classification and Tracking (SCAT) Device 


DESCRIPTION: This device is a mechanical nuise maker which, when attached 
to the hull of a moving submarine, generates noise that can be tracked by 
a destroyer's sonar. 


(1) SPECIFIC OBJECTIVE: Determine the surface ship's ability to classify 
and track a submerged submarine using the SCAT device. 


(MOE), = Average detection range of submarine with 
SCAT device attached 
(MOE ) 4 = Average maintenance of contact range 


(2) SPECIFIC OBJECTIVE: Determine the capability of a SCAT device to hit 
and attach to the hull of a submerged submarine. 


(MOF), = Probability of hit 


« Number of hits recorded 
umber of rounds fire 


(MOE), = Probability of hit and attachment 


(Uaee’ of devices which hit and) 
attached to the submarine 
umber of rounds fir 


(MOE), = Probability of hit, attachment and 
proper operation 
(ee of devices which hit and attached ) 


« sto a submarine and then operated properly 
er of rounds fir 


REFERENCES: (1) Final Report on Project C/S25 FY62 
"Concurrent Evaluation of SCAT Using Hedgehog Delivery” 
4 Sep. 1962, CONF. 

(2) Final Report on Project C/V10 FY64 

"Concurrent Evaluation of Airborne Dispensing System for 
Submarine Classification and Tracking Device (SCAT), Mk 1 
Mod 0" 
28 Sep. 1964, CONF. 
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ADCS - Electro-Acoustic Decoy 

DESCRIPTION: This system is designed for the protection of destroyer- 
type ships from acoustic homing torpedoes. It is a towed acoustic 
projector that transmits a selectable variety of sound signals into the 
sea to decoy torpedoes away from the intended target ship. 


(1) SPECIFIC OBJECTIVE: Determine ability of system to decoy passive 
torpedoes. 


(MOE), = Percent time decoy controlled the torpedo 


Total amount of time 
Total amount of time 
(torped was inglu- ) { torpedo spent τ 


ing after acquiring 
enced by decoy 
{ΠΡ 84} run time after the torpedo enabled) 
until first hit or motor cut-off 


(MOE). = Probability of preventing a hit on the target ship 
« 1 - Number_of hits on target ship 
umber of va torpedo runs 
ASSUMPTIONS : 

(1) If no countermeasure is present, the torpedo would hit the target 

ship on initial attack. 

(2) The target ship is unaware of the torpedo being launched and 

therefore remains on steady course and speed. 

(3) The target ship was considered to be hit when either the torpedo 
entered a given length line conformal to the edges of the target 
ship or the torpedo was looking within a given azimuth angle of the 
target ship's propellers and had entered a circle of given radius 
about the propellers. 

Valid torpedo runs are based on subtracting from the number of 
torpedo launches the number of runs with torpedo malfunctions, 
improper geometry, erratic torpedo behavior, lost torpedoes, 
improper torpedo settings and decoy off. 


REFERENCE: Final Report on Project C/S63 
"Evaluate the NIXIE Torpedo Countermeasure System" 
21 April 1971, SECRET 


(4 


---- 
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ADC6 - Acoustic Noisemaker 


DESCRIPTION: This {is an expendable, elec’ ‘o-mechanical, broadband acoustic 
noisemaker designed as a torpedo countermeasure. 


(1) SPECIFIC OBJECTIVE: Determine capability of noisemaker to decoy 
torpedoes. 


MOE = Probability uf decoying a torpedo 
~ Number of runs on which torpedo was decoyed 
umber of va torpedo runs 
‘ ASSUMPTION: To be considered effective the beacon must prevent the torpedo 
| from completing an attack on the target at anytime during the operation of 


the beacon. 


REFERENCE: Final Report on Project 0/S97 
"Conduct an Operational Evaluation of the NAE Beacon Mk 3 Mod 1" 
28 July 1967, SECRET 


ADC7 


ADC7 - Acoustic Minesweeping Device 


DESCRIPTION: This is a motor-driven, cavitation-type acoustic minesweeping 
device which is designed to counter acoustic sea mines by generation of 
broadband sound. 
(1) SPECIFIC OBJECTIVE: Determine minesweep capabilities of device. 
(MOE), = Maximum lateral actuation range for given mine 
type and depth 


(MOE). = Sweep width against a given mine type and depth 
+00 
- f p(x) dx 
0 
(pes of ἐς ἀμ θη 5) 


κ 
"2 » in range band { eangen of 
f=] ( umber of opportunities range band i 
in range band i 


p(x) = lateral range probability of detection function 
k = number of non-overlappins range bands 


where 


REFERENCE: Final Report on CNO Project C/S44 
"Concurrent Evaluation of the Minesweeping and Clearance 
System S26-01, 200-HP Cavitation Acoustic Sweep Device, 
ROTOVAC 6X and 100-HP Cavitation Acoustic Sweep Device 
ROTOVAC 7X" 
6 Dec. 1968, SECRET 
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ADC8 - Acoustic Intercept Receiver (AIR) 


DESCRIPTION: This device is designed to automatically alert submarine 
personnel to active underwater acoustic signals emitted from other 


platforms and/or weapons. 
(1) SPECIFIC OBJECTIVE: Determine detection capability against active 
acoustic torpedoes. 
MOE = Cumulative probability of detection versus range 
(2) SPECIFIC OBJECTIVE: Determine detection capability against active 
search sonars and active sonobuoys. 


(MOE), = Average detection range as a function of active 
sonar type, AIR platform depth, active sonar 
transducer depth and layer depth 


(Μ0Ε), = Average range advantage over counterdetection 


. Average detection range 
verage counterdetection range 


(3) SPECIFIC OBJECTIVE: Determine ability to detect underwater communications. 


MOE = Average detection range 


REFERENCE: Final Report on Project C/S7} 
"Conduct a Concurrent Evaluation of the AN/WLR-9" 


18 Nov. 1971, SECRET 
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ADCS - Submarine Acoustic Warfare System (SAWS) 


DESCRIPTION: This system is designed to provide enhancement of the ability 
to detect and classify acoustic emissions from active and passive targets. 
It provides for an automatic sonar alert upon receipt of radiated line 
spectrum from a torpedo or platform. 


(1) SPECIFIC OBJECTIVE: Evaluate detection capability of sonar system in 
conjunction with this subsystem. 


MOE = Average detection range as a function of submarine type, 
submarine speed and torpedo approach bearing 


(2) SPECIFIC OBJECTIVE: Evaluate sonar system classification capability 
in conjunction with this subsystem. 


(MOE) = Percent correct classification given detection 


« Number of correct classifications . 100 
umber of detections 


(MOE). = Percent runs on which both detection and classification 


occurred 
(rapper. of runs on which detection ae 


Ξ classification Occurred an x 100 


umber of va runs 
(MOE), 5 Percent runs on which both detection and correct 
classification occurred 
ἰμεηιεήςᾶ of runs on which detection am 


.« .correct classification occurred x 100 


er of valid runs 
(MOE), = Average classification time when correct 
(MOE). = Averase classification time when incorrect 


(3) SPECIFIC OBJECTIVE: Evaluate capability of suvmarine to react to 
impending torpedo attack. 


MOE = Probability of detection, correct classification and 
successful evasion 
= Py Po Ps 


where 
ΡῚ = probability of timely detection and classification 
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~ Number _of detection and classification successes 
umber of valid runs 


_f (TysTgT oT) 
umber of valid runs 
(NOTE: For determination of f see assumption.) 


Po = probability of correct classification given detection 


~ Number of correct classifications 
Number of detections 


= probability of successful evasion 

= 9(T,) 

(NOTE: g is determined using a simulation program developed by 
the Naval Coastal Systems Laboratory. ) 


= minimum time available to successfully evade, which represents 
the time prior to impact at which evasion action must begin 
in order to be successful 

= time to impact, which represents the time from torpedo 
detection to torpedo impact if no evasive action were to 
be taken and tlie torpedo ran a direct intercept course 

Τ᾽ = time to classify 

Ty = time for 000 reaction 


Ps 


ΤΊ 


Τ᾽ 


ASSUMPTION: If To - ΤΊ » Ty + Tg» then a run is considered to be 
successful in terms of detection and classification; otherwise, 
unsuccessful. In other words, the MOE is established by measuring 
detection range, converting that to time to impact and, after sub- 
tracting reaction time, assessing whether or not sufficient time 
remains to successfully evade the torpedo. 
REFERENCE: Final Report on Project C/S85 

"Concurrent Evaluation of SAWS (Submarine Acoustic Warfare 

System)" 

7 Dec. 1973, SECRET 


greg, 


Area: 


TABLE 8.2 Operational Test ἃ Evaluation 


Communications (C 


MOE Data Base (Continued) 


ITEM 


UHF Transceiver (AN/WSC-3) 
Sounder Receiver System (SRS) 
Report Receiver-Transmitter (RRT) 
Radio Transmitter (AN/WRA-3) 

Data Communications Set (HICAPCOM) 
Drone Control Set 


Message Processing and Distribution 
System (MPDS) and Facilities Control 
System (FCS) 
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COMMUNICATIONS (C) 


Cl - UHF Transceiver 


DESCRIPTION: This is designed to provide a satellite communications capabil- 
ity for small ships and submarines. It also has a line-of-sight (LOS) mode 


which provides for direct path communications between stations. 


(1) SPECIFIC OBJECTIVE: Determine the adequacy of voice communications for 


both plain voice and secure voice. 
(MOE), = Mean error rate, which is defined as the 
number of words missed per 25-word message 
(MOE), = Probability that a rhyme word transmitted by 
this system is correctly interpreted 
(average number of words 


= 1. - Lwrong per _N-word message 
N 


(MOE), = Percent sentence intelligibility 


(NOTE: (MOE), is determined from (MOE), using a 
conversion scheme developed in "Speech Intelligibility 
in Naval Aircraft Radios", NELC Report, 2 Aug. 1972.) 


(2) SPECIFIC OBJECTIVE: Determine teletype communications performance. 


(MOE), = Mean character error rate, which is defined 
as the average number of character errors 
per 1000 character message as a function of 
satellite elevation angle 


(MOE). = Gross error rate, which is defined as the 
percent of messages that had more than 10 
character errors per 1000 character message 
as a function of satellite elevation angle 


(3) SPECIFIC OBJECTIVE: Determine data communications performance. 


MOE = Bit error rate, which is - ‘ined as the number 
of bits missed per second for a given data 
rate (in bits per second) and transmission mode 
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REFERENCE: Final Report on Project 0/S181 
"Conduct an Operational Evaluation of the UHF Satellite Ship/ 


Submarine SATCOM Terminal (AN/WSC-3)" 
7 Jan. 1974, CONF. 
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(2 - Sounder Receiver System (SRS) 


DESCRIPTION: This is a specialized high frequency radio receiver which 
receives a signal consisting of a specified number of discrete frequencies 
from a sounder transmitter. These frequencies provide an indication of the 
bands of frequencies which may be propagating within a specified range band 
when received and displayed by the Sounder Receiver System. 


(1) SPECIFIC OBJECTIVE: Determine consistency of SRS optimum antenna 
determination. 


MOE = Number of usable CER's 
Total number of CER determinations 
where 
CER = character error rate, which is that number 
of erroneous characters received on a tele- 
type versus a known number of correct char- 
acters transmitted. 


(2) SPECIFIC OBJECTIVE: Determine consistency of SRS frequency indications. 
owned of times a desired frequency wa 


(MOE). = ascertained 
1 (Nunber of times a decision was made) 
to select a new frequency 
= of usable non-SRS operating fre- 


quencies lying outside of the recommended 
operating ranges of both the non-SRS cir- 


(MOE), = cuit antenna and the optimum antenna 
2 ( otal number of usable operating 1) 
quencies for each radio path 

(NOTE: (MOE). is called the ratio of failures to 

total attempts, since a usable frequency outside 

the recommended operating range was considered a 

failure of the SRS to indicate a usable frequency.) 

REFERENCE: Final Report on Project 0/S107 

"Conduct an Operational Evaluation of the Oblique Incidence 
Ionospheric Sounder System" 

23 Sept. 1969, UNCL. 


B-35 


C3 


C3 - Report Receiver-Transmitter (RRT) 


DESCRIPTION: This equipment is designed to apply and detect information in 
the form of low frequency signals modulating the carrier of any voice comnuni- 
cation equipment. It is used in conjunction with shipboard and aircraft 
communications equipment. 


(1) SPECIFIC OBJECTIVE: Determine communication capability. 
(MOE), = Percent of RRT messages received 
« -Number_of RRT messages received | 100 
umber 0 transmissions 
(MOE). = Percent RRT messages received that were displayed 


accurately 
[panes of accurately ΠΡ ayes) 


a \RRT messages 
(Number of RRT messages) x 100 
received 


REFERENCE: Final Report on Project F/0 148 FY63 
"Fleet Operational Investigation of ASW Report Receiver- 


Transmitter" 
16 April 1964, CONF. 
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(4 - Radio Transmitter 


DESCRIPTION: This radio communications transmitting equipment is designed 
for use as a modulator for standard shipboard and submarine transmitters. 


(1) SPECIFIC OBJECTIVE: Evaluate transmission accuracy. 


(MOE), = Percent of transmissions detected which are satis- 
factorily transcribed into legible copy 


Number of detected transmissions 
satisfactorily transcribed into 

. \legible co x 100 
umber of detected transmissions 


(MOE). = Percent transmissions with textual errors 


(Humps? of {ΡΕΣΤΑΕΊΘΗΣ, 
with textual errors 


" “Number of transmissions * 00 
(MOE), = Average number of errors per message 
(MOE), = Average number of errors per character sent 


REFERENCE: Final Report on Project 0/S66 FY63 
"Conduct an Evaluation of the AN/WRA-3 Radio Transmitter" 


11 April 1963, SECRET 
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(5 - Data Communications Set 


DESCRIPTION: This set is designed to provide secure and rapid tactical 
communications between ships in dispersed formations. 


(1) SPECIFIC OBJECTIVE: Determine traffic handling capability. 
MOE = Data rate achieved (in words per minute) 


REFERENCE: Final Report on Project C/S19 FY 61 
"Concurrent Evaluation of a High Capacity Communications 


(HICAPCOM) System" 
21 August 1962, CONF. 
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C6 - Drone Control Set 


DESCRIPTION: This system is designed to send commands, receive telemetry 
and track a drone, both in range and azimuth, via an RF (radio frequency) 
link from either a shore or shipboard installation. 


(1) SPECIFIC OBJECTIVE: Determine message decoding performance. 


MOE = Command message error probability, which is defined 
as the probability that the system transponder will 
error in decoding a word in the command message )ink 
for given maximum word length (bits) and received 
target strength (dbm) 


« Number of words with decoding errors 
er of wo ecoding attempts 


REFERENCE: Phase II Report on Project X/C8 
"Conduct an Operational Assist of the Integrated Target Control 
Sys tem" 
5 March 1974, UNCL. 
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(7 - Message Processing and Distribution System (MOPS) and Facilities 


Control System (FCS) 


DESCRIPTION: 


The MPDS is a stored program, three computer system designed 
to process, store, log and internally distribute record message traffic 
and digital data "on-line" with radio receiving and transmitting equipment. 


C7 


The FCS provides for quality monitoring of communications circuits, for 
generation of central frequency and time signals, and for patching and 
adjusting of radio frequency and terminal equipments. 


(1) SPECIFIC OBJECTIVE: Evaluate the capability of the MPOS to do message 


processing. 


MOE = fl P, 


where 


message recognition factor 

message distribution factor 

message journaling factor 

message transmittal relay factor 

broadcast screening accuracy 

} - Number of broadcast screening errors 
umber of broadcast messages 

operational availability 


1 - [918] downtime 
ota! time in use 


measure of effectiveness for the FCS 


1 2 
antilog — p> log C, 


number of circuits 

4Ἷ individual circuit/channel reliability 
percentage 

( Tins jth circuit/channel τ 


of _tratfic quality 100 
Demand usage time : 
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(NOTE: P, expresses the success of the FCS in maintaining teletype 
circuits of traffic quality.) 
ASSUMPTION: A reliable traffic quality circuit is a circuit condition of 15% 
or less black bias distortion and the MPDS receiving messages of sufficient 
quality to process. 
REFERENCE: Final Report on Project X/S7 
"Conduct an Operational Assist for CVAN 68 Message Processing 
and Distribution System (MPDS)/Facilities Control System (FCS)" 
29 Nov. 1972, CONF. 
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TABLE B-2 Operational Test ἃ Evaluation 
MOE Data Base (Continued) 


Area: DOata ἃ Display (DD 


CODE ITEM 
001 Naval Tactical Data System (NTDS) 
002 Computer Controlled Commard and Control 
System (DATACOURTS) 
DD3 Antisubmarine Contact Analysis Center 
(ASCAC ) 
004 ASW Avionics System (ANEW) 
005 Electronic Display System (EDS) 
006 Teletype Integrated Display System 
Σ (TIDYY 
\ 007 Data Relay System 


ἀπὸ ἀπ a ns ὡπῷὸὸ ὦ“ Se 
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DATA_& DISPLAY (00) 


00] - Naval Tactical Data System (NTOS 


DESCRIPTION: This is a computerized tactical control system which is 
designed to collect, exchanye, process and evaluate information in an 
anti-air warfare situation. 


(1) SPECIFIC OBJECTIVE: Determine the accuracy of the system to depict 
the location of a given air target using three NTDS-equipped ships. 


(MOE), » Accuracy with which the system (based on 3 ships) 
is able to locate a given target as compared to the 
position determined by a precision radar tracking 
system used as a standard 


(NOTE: A measure of this accuracy would be either the 
average 50th or the goth percentile radius of a circle 
centered on the actue] positions which would enclose the 
three NTDS positions.) 


(MOE), = Position radius of the NTDS target among the three 
NTDS ships, which is defined as the radius of the 
smallest circle which will enclose all three NTDS 
symbol positions 


(NOTE: This is a measure of the relative accuracy of position 
of a NTDS target independent of an outside reference system. ) 


REFERENCE: Final Report on the Naval Tactical Data System Service Test 
Part III Materiel Aspects of the Service Test Equipment 
Task IV of Phase II, Project C/S5 FY60 
"Concurrent Evaluation of the Naval Tactical Data System (NTDS)" 
18 Sept. 1962, CONF. 
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002 - Computer Controlled Command,and Control System 


DESCRIPTION: This system is designed to unite the ship's sensors and 
weapon systems. It consists of a general purpose digital computer, an 
Evaluation Display and Control] Console, a Teletype and Paper Tape Reader. 


(1) SPECIFIC OBJECTIVE: Evaluate sensor alerting capability. 


(MOE), = Probability of ESM (Electronic Warfare Support 
Measures) detection causing an alert 
(ΕΓ of times ESM detection was sUccesetill) 
= Jin causing an alert to the proper sensor 
( umber of alert attempts due to aM) 
detection 
(MOE). = Probability of search radar detection causing an 
alert 


Number of times search radar detection was 
successful in causing an alert to the 


Ἂ se sensor/sensors 
( umber of alert attempts due to sateen) 


radar detection 


(MOE), = Probability of evaluator input causing an alert 


(pee of times evaluator inputs were SUCEES? 
. ful at alerting ESM and/or search radars 

/Number of alert attempts due 0} 

\evaluator inputs 
ASSUMPTIONS : 
(1) When one sensor notifies this C&C system that is has detected 
a target, the system evaluates the sensor in relation to the 
threat. If this sensor does not provide sufficient information, 
is not the hest sensor for the threat, or if the sensor is over- 
loaded, another sensor is alerted to track the threat. If an 
alert to any sensor is not responded to from that sensor by an 
entry, the system will continue alerting the sensor until it 
does receive a reply entry. 
The evaluator can cause alerts when he acts as initial detector, 
designates to a reaction system, or deletes a target from the 
systen. 


(2 


—_ 
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(2) SPECIFIC OBJECTIVE: Evaluate capability to correlate sensor inputs. 


(MOE ) = Probability of successful search radar-to-search 
radar correlation 


{παπδετ of times search radar-to-search Sota 
correlation is achieved 


: (Nunber of search radar-to-search radar) 
correlation attempts 

(MOE), = Probability of successful ESM-to-search radar 

correlation 

μων of times ESM-to-search baad 

correlation is achieved 

(Nan er of ESM-to-search pede 

correlation attempts 

(MOE), = Probability of successful FCS (Fire Control 
System) lock-on-to-search radar correlation 


(ee of times FCS lock-on-to-search reer) 
correlation is achieved . 
( umber o ock-on-to-search ra δ 
correlation attempts 
(NOTE: (MOE), (MOE). and (MOE), are measures of search 


radar correlation success. ) 


(MOE), = Probability of successful search radar-to-ESM 
correlation 


(Number of times search radar-to-ES") 
correlation is achieved 

(na er of search age eal 
correlation attempts 


(MOE), = Probability of successful FCS lock-on-to-ESM 


correlation 


ἰμορῶνη of times FCS Peet eon store a) 
= correlation is achieved 
( umber 0 ock-on-to- 
correlation attempts 
(NOTE: (MOE), and (MOE), are measures of ESM correlation 


success. ) 
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(ΜΟΕ)ς = Probability of successful search radar-to-FCS 
lock-on correlation 
(Humber of times search radar-to-FCS Pek 20) 
correlation is achieved 
( umber of search radar-to-FCS loc sen} 
correlation attempts 

(MOE )2 = Probability of successful ESM-to-FCS lock-on 
correlation 


[fuser of times ESM-to-FCS peeEEOD) 
correlation is achieved 


= (Number of ESM-to-FCS Tock-on) 
correlation attempts 

(MOE), = Probability of successful FCS-to-FCS 
lock-on correlation 


βωμόν of times FCS-to-FCS peereen 
correlation is achieved 

( umber 0 -to- Beco 

correlation attempts 
(NOTE: (MOE) ¢, (MOE). and (MOE), are measures of fire 


control system correlation success.) 


(MOE) = Probability of evaluator correlation success 


Number of threats initially entered by the 
evaluator and subsequently entered by a 
search radar 


χὰ (Number of threats Initially entered by) 


the evaluator 


ASSUMPTIONS; 
(1) As each new entry arrives in the system, it is compared with 


all existing items in the threat file. If the new entry is 
within the prescribed correlation bins in range and bearing, and 
if the classification is consistent with the classification in 
the threat file, then the two items are said to correlate. 

(2) Search radar correlation success {is assumed to occur when the 
threat file track is initiated by a search radar entry and a 
new input is received from another search radar, ESM, or FCS 


Tock-on. 
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(3) ESM correlation success is assumed to occur when the threat file 
track is initiated by an ESM entry and a new input is received 
from either a search radar or a FCS lock-on. 

(4) Fire control system correlation success is assumed to occur when 
the threat file track is being updated by a FCS and search radar 
enters a new track, ESM enters a bearing and classification, or 
another FCS locks on the same target. 


(3) SPECIFIC OBJECTIVE: Evaluate weapons system engagement capability. 
(MOE), = Probability of successful engagement 
. Number of threats effectively engaged 
Number of threats detecte 
(MOE). = Median total reaction time 
= Roy + Rage * Roepe 


where 

= median reaction time from detection to assign 
median reaction time from assign to ready- 
to-fire 

median reaction time from ready-to-fire to 
fire 


Roa 
βαρ" 


Rare 


REFERENCE: Final Report on Project C/S68 
"Conduct a Concurrent Evaluation of ASMD (Anti-Ship Missile 
Defense) Near Term Program Equipments DATACOURTS (Data 
Correlation and Transfer System) Portion" 
17 Oct. 1972, SECRET 


B-47 


003 


003 - Antisubmarine Contact Analysis Center (ASCAC 


DESCRIPTION: This is a system using specially configured analysis equipment 
and specially trained personnel (called the Antisubmarine Contact Team 
(ASCAT)) to process and interpret raw sonic intelligence received via radio 
link or other means from airborne, surface and subsurface sensors. 


(1) SPECIFIC OBJECTIVE: Evaluate the ability of the ASCAT and/or sensors 
to classify contacts. 


(MOE), = Percent correct classifications 
᾿εμω κά of correctly classified: 
. sSignatures x 100 
(ea er of classificat on) 
opportunities 
(MOE ) = Median time for classification 


REFERENCE: Fina] Report on Project F/0 117 
"Fleet Operational Investigation of a CVS Antisubmarine Contact 
Analysis Center (ASCAC)" 
11 July 1963, SECRET 
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004 - ASW Avionics System 
DESCRIPTION: This system consists of integrated navigation, communications, 
sensor, display, maintenance, ordnance and date processing subsystems. 


(1) SPECIFIC OBJECTIVE: Evaluate the capability of an aircraft equipped 
with this system to perform detection, classification, localization 
and attack operations. 


(MOE), « Average time to detect/classify, which is the 
average of times from the first detection oppor- 
tunity until a valid target detection was 
announced by a sensor operator 

(MOE), = Average time from detection to attack, which is 

| _ defined as the average of times from the first 

valid detection until a simulated attack was 
delivered against the target 
(MOE). = Average time to attack for short range localization, 

- which is defined as the average of times from the 
first valid contact by Julie, active sonobuoy or 
MAD until a simulated attack was delivered against 
the target 

F (MOE), = Average total time to attack, which is defined as 

| the average of times from the first detection 
opportunity to the time of delivery of a simulated 
attack 

(MOE), = Lofar detection/opportunity ratio 

Number of events with valid Lofar detections 


“ "Number of events containing a valid opportunity 


(MOE) = Valid classification/total classification ratio 


Ϊ . Number of valid target submarine classifications 
mber of announced target submarine classifications 


| 


aa ἱ 


(MOE). = Successful attack/short range localization ratio 
(pene of successful attacks, given ἢ 
= short range sensor contact 
(Runber of events with a valid JuTfe,) 
active sonobuoy or MAD contact 


~ (MOE), = Successful attack/total attack ratio 
] .« Number cf successful attacks 


Number of attacks conducted 
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(MOE), = Successful attack/total event ratio 
. Number of successful attacks 


Number of events conducted 
(MOE) 9° Probability of successful attack 


(NOTE: (MOE), is computed via a detailed Markov chain 
model described in an enclosure.) 
REFERENCE: Final Report on Project F/0228 
"Fleet Operational Investigation to Establish the Effective- 
ness of the P-3 ANEW Compared to the DELTIC P-3A/B" 
31 Oct. 1967, CONF. 
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005 - Electronic Display System 

DESCRIPTION: This is a data handling, display and exchange system used 
in fleet air defense to provide data link exchange or detection and 
tracking information on airborne targets. 


(1) SPECIFIC OBJECTIVE: Evaluate accuracy capability against air targets. 


(MOE), = Percent of total number of valid tracks as a 
function of store tracking error (deg) 

(MOE), = Percent of total number of valid tracks as a 
function of store speed error (kts) 

(MOE), = Percent of total number of valid tracks as a 
function of maximum separation of tracks (nm) 


REFERENCE: Final Report on Project OP/S480/S67 
"Evaluation of the Electronic Data System (EDS)" 
1 Fe. 1960, UNCL. 
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006 - Teletype Integrated Display System (TIDY 

DESCRIPTION: This is a small-scale data processing system designed to 
improve current methods of displaying the tactical data available from 
the NTDS Link 14. 


(1) SPECIFIC OBJECTIVE: Determine plot accuracy. 
(MOE), = Percent range accuracy 
= 100% - % absolute range error 


(MOE). = Cumulative distribution of absolute range 
error as a percent of range scale 


(2) SPECIFIC OBJECTIVE: Determine capability of the TIDY computer to 
accurately maintain the navigational position of own ship (0S) with 
respect to Data’Link Reference Point (DLRP). 


(MOE), = Average navigation error rate (nm/hr) 
(MOE). = Maximum navigation error rate (nm/hr) 
(MOE), = Maximum navigation error (nm) 
(3) SPECIFIC OBJECTIVE: Determine track processing capability. 


(MOE), = Average actions per minute (APM) 
ἰβαμεν of actions which took piace 


= sin_a given interval 
nterval Lengt 


(NOTE: The “actions” consist of new tracks which 
appear on the plot, old tracks which are dropped, 
and those tracks that are updated. This APM figure 
does not necessarily represent the true number of 
actions during the interval due to the possibility 
that a particular track may have been added or 
updated and then dropped, or it may have been 
updated once and then, upon a second update, the 
symbol may have been moved with all previous data 
scrubbed from the plot board.) 


006 


(MOE), - Plot track ratio 
(Number of plot positions appearing ὉΠ) 


.« εἶδα Summar. Plot 
Total number of tracks 


(NOTE: (MOE). is a measure of track coherency.) 


REFERENCE: Final Report on Project 0/S179 
“Operational Evaluation of the TIDY (Teletype Integrated 
Display System)" 
10 May 1973, CONF. 


007 


007 - Data Relay System 

DESCRIPTION: This system is designed to provide a two way radio link for 
intermittent exchange of sonic data between an aircraft and elements of 
SOSUS. The system provides a side by side display of sonobuoy and Sound 
Search Station (SOSS) data on either the SOSS or aircraft display equipments. 


(1) SPECIFIC OBJECTIVE: Evaluate operator classification capability. 


(MOE), = Percent correct classifications as submarine or 
non- submarine 
Number of correct classifications x 100 


" Number of classification opportunities 


(MOE). = Percent friendly targets correctly recognized 


(Number of friendly targets) 
« .correctly recognized x 100 


(ameer of friendly target ) 
classification opportunities 


(MOE), = Percent unfriendly targets correctly 
recognized 
jNueeee of unfriendly ἐνόν νυν) 
« .correctly recognized 100 
(Runber of anfrtandty target : 
classification opportunities 
(MOE), = Average classification time per operator 
(MOE). = Difficulty index for submarine or non-submarine 
decision 


(eee of crrrect operator decisions oe 
submarine or non-submarine 


(Nunber of operators classitying the) 


signature 
(MOE). = Difficulty index for friendly or non-friendly 
decision 
ραν of correct operator decisions δ: 


« friendly or_non-friend] 
(haber of operators classifying the) 
signature 
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(MOE), = Difficulty index for conventional or nuclear 
powered decision 
(eet of correct operator Gecisiots) 
. sas conventional or nuclear poweres 
( er of operators classifying t a 
signature 
REFERENCES: (1) Final Report on Project F/0116 FY62 
(Title Classified) 
15 Oct. 1963, SECRET 
(2) Supplementary Report on Project F/0116 FY62 
(Title Classified) 
23 Jan. 1964, SECRET 
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Area: 


TABLE B-2 Operational Test & Evaluation 


MOE Data Base (Continued) 


Electromagnetic Detection & Countermeasures (EDC 


CODE 


EOC] 
EDC1-1 


EDC1-2 
EDC1-3 
EDC2 
EDC3 
EDC4 


EDC5 
EDCE 


EDC7 
EDC8 
EDC9 


EDC10 
E0C1) 


EDC 12 
EDC 13 


FDC14 
EDC15 


EDC 16 
EDC17 


ITEM 


Radar 


Air Search Radar (AN/SPS-49(XN-1), 
AN/SPS-50 (XN-1), AN/SPS-52, 
AN/SPS-58) 


Air Traffic Control Radar (AN/SPN-43) 
Airborne Early Warning Radar 

IFF System (AN/SLQ-20, AN/UPX-24) 
Target Recognition Set (AN/ASX-2 (TRISAT)) 


Mine Contro] Wire Detector 
(L Mk 3X Mod 0 Locator (RADRAG) ) 


Early Warning and Surveillance Receiver 
(AN/WLR-8(V)2 ESM Receiver) 


Minesweeping Equipment (Mk 105 Mod 0, 
Mk 104 Mod 1) 


Mine Defense System (SHADOWGRAPH) 
Degaussing System 


Automatic Permanent Magnetic Compensator 
(APMC ) 


MAD Device (AN/ASQ-8) 


Electronic Warfare System (AN/SLQ-27 
(XN-1) SHORTSTOP) 


ECM Receiving Antenna (AS-899/SLR) 


Shipboard Direction Finding System 
(AN/SRD-19 (XN-1)) 


Radio Direction Finder (AN/BRD-7) 


Radio Frequency Osciliator (RFO) 
(0-1331 (XN-1)/ULQ-6) 


Deception Repeater (AN/SLQ-17(V)) 


Aircraft Radar/Missile Homing and 
Warning Receiver 
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Area: Electromagnetic Detection & Countermeasures (EDC) (Continued) 


CODE 
EDC18 


EDC19 
EDC20 


ITEM 


Radio Frequency Amplifier 
(AM-4530/ULQ-6A) 

Decoy Repeater Buoy (AN/ULQ-5) 
Noise Jammer (ALT-27) 
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ELECTROMAGNETIC DETECTION ἃ COUNTERMEASURES (E0C) 


EDC1 - Radar 


EDC1-1 Air search radar 


DESCRIPTION: This system is a shipboard air search radar designed for 
operation in the presence of countermeasures. 


(1) SPECIFIC OBJECTIVE: Evaluate radar detection performance. 


(MOE), = Cumulative distribution of maximum detection range, 
j.e., percent of runs on which detection was made 
by given range 

(MOE). = Single scan probability of detection as a function of 
range for given target speed, target altitude and 
antenna lobing 


. Number of detections (blips) 
umber of scans 


4 
J 
J 
| 
ΙΗ 
Ϊ 
| 
| (MOE), = Median detection range for given radar mode, target 
type and target altitude 
(MOE) 4 = 90% cumulative detection range for given radar mode, 
target type and target altitude. 
(MOE), = Median minimum detection range for given target 
| altitude and elevation scan limit 
| 
] 
| 
| 
| 
| 
᾿ 


ASSUMPTION: Two types of detection criteria employed for computa- 
tion of (MOE), were: (1) first detection of an incoming aircraft by 
an alerted operator, and (2) observation of two blips in any three 
consecutive scans. Use of the second criterion reduced the influence 
of random, strong, noise returns with characteristics similar to 
aircraft target returns, and more closely approximated the detection 
decision point of an unalerted operator. 


(2) SPECIFIC OBJECTIVE: Evaluate radar tracking performance. 


(MOE), = Percent of runs on which tracking was held to a given 
range 

(MOE). = Average index of track sulidity as a function of slant 
range for given target altitude and video category, which 
is defined as the ratio of blips observed to the total 
number of scans within a specified range band 
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(3) SPECIFIC OBJECTIVE: Evaluate radar capability to estimate target 
position/location. 
(MOE), = Cumulative range error distribution 
(MOE), * Cumulative bearing error distribution 
(MOE), = Cumulative altitude error distribution 
(MOE), 2 Mean bearing resolution for target within given 
range band 


(4) SPECIFIC OBJECTIVE: Evaluate capability of system to perform 
control of air intercepts. 


MGC © Probability of successful intercept 
. Number of successful intercepts 
Number of Intercept attenpts 
(5) SPECIFIC OBJECTIVE: Evaluate the capability of the system to provide 
interface with the Weapons Designation Equipment (WDE). 


MOE = Mean acquisition time 


REFERENCES: (1) Final Report on Project C/$34 

"Concurrent Evaluation of AN/SPS-49(XN-1) and AN/SPS-50(XN-1)" 
7 Feb. 1966, CONF. 

(2) Final Report on Project ¢/S46 
“Conduct a Concurrent Evaluation of the AN/SPS-52 Radar" 
25 sarch 1970, CONF. 

(3) Final Report on Project C/S72 
"Conduct a Concurrent Evaluation of the AN/SPS-58 Radar 
System" 
27 July 1971, CONF. 


EDC1-2 Air traffic control] radar 


DESCRIPTION: This shipboard system is a medium range, two-coordinate CATC 
(Carrier Air Traffic Control) radar. 


(1) SPECIFIC OBJECTIVE: Determine radar detection and tracking performance. 


(MOE), = Average index of track solidity as a function of slant 
range for given target altitude, target type and antenna 
tilt angle 


(MOE), i! 


(MOE), = 


(MOE), - 
(MOE). 
(MOE), 


EDC] 


Mean radar range resolution, where range resolution 
is based on the range difference of the leading edge 
of two targets at the same bearing as the two target 
blips started to separate or merge 


Mean radar bearing resolution, where bearing resolu- 
tion is based on the bearing difference of the center 
of two targets at the same range as the two target 
blips started to separate or merge 


Mean radar range error 
Mean radar bearing error 


Average minimum target detection range as a function 
of target altitude, target type, antenna polarization 
type and antenna tilt angle 


Average maximum target detection range as a function 
of target altitude, target type, antenna polariza- 
tion type and antenna tilt angle 


REFERENCE: Final Report on Project 0/S123 
"Conduct an Operational Evaluation of the Improved AN/SPN-43" 


7 Sept. 1967, CONF. 


E0C1-3 Airborne early warning radar 


DESCRIPTION: This system is designed to detect, identify and track air- 


borne (overland 


and overwater) and surface targets. 


(1) SPECIFIC OBJECTIVE: Determine the capability to detect, identify 
(IFF) and track targets 
(MOE), = Blip/scan ratio as a function of range 


for given target type, altitude, speed 
and radar mode 


Number of times target radar return 
was present on the scope for a given 


range band 
(Runber of antenna scans In a givin} 


range band 


. EOC) 


(MOE ). - Probability of successful target aircraft 
identification 


,. Number of valid replies 
umber 0 nterrogations 
(2) SPECIFIC OBJECTIVE: Determine the capability of the passive detection 
system (PDS) to fix stationary electromagnetic emitters. 
MOE = Circular error probable (CEP) of emitter site position 


REFERENCE: First Partial Report on Project C/V22 
"Conduct a Concurrent Evaluation of the E-2C Weapon System" 
19 April 1973, SECRET 
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EDC2 - IFF System 
DESCRIPTION: An IFF system, as part of a radar system, is designed for 
interrogating and identifying aircraft. 


1. SWECTRIC UBJELTIVE: Evaluate system ability to identify aircraft. 


MOE = Single scan probability of detection as a function of 
target range and azimuth separation of target aircraft 


.« Number of aircraft identifications 
umber of radar scans 


(2) SPECIFIC OBJECTIVE: Evaluate detection capability. 


(MOE), = Probability of aircraft detection 
. Number of detections 


Number of detection opportunities 


(MOE). = Percent of warning alerts detected or confirmed 


Renbioat of warning aes} 
detected or confirmed 


Τ ἢ mber of warning alerts aes 
REFERENCES: (1) Final Report on Project P/S3 

i “Conduct an Operational Appraisal of SEESAW II (AN/SLQ-20)" 
2 Feb. 1970, SECRET 

Ἴ (2) Final Report on Project C/S82 

| "Conduct a Concurrent Evaluation of the AN/UPX-24 Central 

- ἱ IFF System" 

J 17 Oct. 1973, CONF. 
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EDC3 - Target Recognition Set 

DESCRIPTION: The TRISAT (Target Recognition Through Integral Spectral 
Analysis Techniques) recognition set is used to recognize jet aircraft 
engines. 


(1) SPECIFIC OBJECTIVE: Evaluate the ability of the system to correctly 
identify (i.e., classify) programmed aircraft targets. 


(MOE), = Probability of target correct classification 
« Number of targets correctly classified 
umber of runs against programmed targets 
(MOE), = Classification range as a function of track initiation 
range 
(MOE), = Average low confidence classification range 
(MOE) = Average high confidence classification range 


REFERENCE: Summary Report of Project X/\17 
"Conduct an Operational Assist for the AN/ASX-2 (TRISAT) 
Recognition Set" 
17 Oct. 1972, SECRET 
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EDC4 - Mine Control Wire Detector 


DESCRIPTION: This system is designed to detect control wires leading to 
command-detonated mines. 
(1) SPECIFIC OBJECTIVE: Evaluate detection performance. 


(MOE), = Probability of successfully detecting a mine wire 
« Number of successes 


Number of opportunities 


(MOE), = False alarm rate 
~ Number of false alarms reported 
umber of miles swept 
REFERENCE: Final Report on Project 0/5178 
"Conduct an Operational Evaluation of the L Mk 3X Mod 0 


Locator (RADRAG)" 
22 June 1973, CONF. 
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EOCS - Early Warning and Surveillance Receiver 
DESCRIPTION: This device is designed as a tactical early warning and 
surveillance receiver for submarine use. 


(1) SPECIFIC OBJECTIVE: Evaluate detection performance. 


(MOE) = Average operator integration time as a function of frequency 
(MOE), = Maximum detection range 


ASSUMPTION: Integration time was measured from the time of signal 
intercept to the time of completed analysis. 


(2) SPECIFIC OBJECTIVE: Evaluate system accuracy. 


(MOE), = Mean percentage error in frequency 


« Actual frequency - Observed frequency . 100 
ctual frequency 


(MOE). = Mean percentage error in PW (pulse width) 


. Actual PW - Observed PW 
τὴς x 100 


(MOE), = Mean percentage error in PRF (pulse repetition frequency) 


. Actual PRF - Observed PRF 
tay ae 100 


(MOE), = Mean bearing error (deg) 
(3) SPECIFIC OBJECTIVE: Evaluate ability to intercept signals. 
MOE = Probability of signal intercept 
. Actual _ intercepts 
empted intercepts 
REFERENCE: Final Report on Project C/S94 
"Conduct a Concurrent Evaluation of the AN/WLR-8(V)2 ESM 


Receiver" 
26 Oct. 1973, SECRET 
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EDC6 .- Minesweeping Equipment 

DESCRIPTION: This is a helicopter towed, unmanned device desiqned to counter 
magnetic, acoustic or combination magnetic-acoustic sea mines that present 

a hazard to conventional minesweepers and amphibious craft. 


(1) SPECIFIC OBJECTIVE: Evaluate the capability to sweep mines. 
(MOE), = Probability of actuation as a function of lateral 
range 
rents of mines actuated in a) 
. -given range band 
(Runber of runs in a given} 
range band 
(MOE). = Aggregate sweep width, which is defined as 
twice the area under the probability of 
actuation versus lateral range curve 
(MOE). = Maximum sweep (actuation) range 


(2) SPECIFIC OBJECTIVE: Evaluate the vulnerability of the helicopter and 
minesweeping platform to mine actuations. 


MOE = Damage probability 
(iamper of actuations causing p!ume ) 


. damage to the helicopter or piatform 
umber of actuations where the heli- 
copter's or platform's closest point 
of approach jis less than the plume's 


projected radius 
ASSUMPTION: If the plume of the actuated mine touched either the 
helicopter or platform, damage is assumed to occur. 


REFERENCE: Final Report on Project 0/V7) 
"Conduct an Operational Evaluation of the Magnetic Minesweeping 


Gear Mk 105 Mod 0 and the Combined Magnetic (Mk 105 Mod 0) -- 
Acoustic (Mk 104 Mod 1) Minesweeping Gear, PAGE" 
19 August 1970, SECRET 
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EDC7 - Mine Defense System 

DESCRIPTION: This system is designed to locate, classify and destroy 
bottom mines. It consists of a classification subsystem, using under- 
water classification vehicles and associated shipboard display and contro] 
facilities, a precise navigation subsystem, an automatic plotting sub- 
system and a mine neutralization subsystem. 


(1) SPECIFIC OBJECTIVE: Determine classification subsystem capability 
to locate and classify mines. 


(MOE), = Mine and non-mine detection probability 


(Hater of detections of mines 
and non-mines 


5 (tunbér of detection” 7" 


opportunities 
(MOE) 9 = Mine detection probability 


~ Number of mine detections 
(a er of detection ) 
opportunities for mines 


(MOE), = Probability of classifying a mine correctly 
~ Number of mines correctly classified 
umber of mine detections 
(MOE) 4 = Probability of classifying a non-mine correctly 


ieee of known non-mines coueckr 
classified 


= (Number of opportunities to classify) 


known non-mine targets 
(MOE). = Average time to locate and classify mines 


(2) SPECIFIC OBJECTIVE: Determine system capability to neutralize and 
clear minefields. 


(MOE), = Average diving time per mine for neutralization 
(MOE). = Average time to locate, classify and neutralize 
mines in a minefield of specified size 
(MOE). = Clearance rate, i.e., area neutralized per hour 

(MOE), = Percent mines neutralized 
2 Number of mines neutralized 5 jo 
umber of mines in fie 
REFERENCE: Final Report on Project F/096 FY62 

"Fleet Operational Investigation of Mine Defense System S-101 
( SHADOWGRAPH) " 

4 Jan. 1963, SECRET 
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EDC8 - Degaussing System 
DESCRIPTION: Miniaturized degaussing system for use in submarines. 
(1) SPECIFIC OBJECTIVE: Determine reduction in the magnetic field/ 
signature of submarines using a degaussing system. 
(MOE), = Percent reduction in average MAD detection range 
(MOE), = Percent reduction in average magnetic mine actuation 
distance 


REFERENCE: Final Report on Project (7511 FY 61 
“Concurrent Evaluation of a Miniaturized Degaussing System 


for Use in Submarines" 
14 Aug. 1962, CONF. 
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EDC9 - Automatic Permanent Magnetic Compensator (APMC) 


DESCRIPTION: This equipment is designed for use in aircraft equipped 
with inboard MAD equipment and to enable automatic permanent magnetic 
field compensation by semfautomatically adjusting and then maintaining 
the current in the compensating coil assembly. 


| 
| 
| (1) SPECIFIC OBJECTIVE: Determine the capability to provide improved 
permanent magnetic compensation. 
j (MOE), = Figure-of-merit (FOM), which is the sum, disregarding 
: polarity, of the maneuver averaged noise signals, in 
| gammas, generated during a MAD noise box (i.e., the 
procedure for determining MAD maneuver signal noise 
| levels). 
(NOTE: FOM is an indication of the overall degree of com- 
pensation. ) 
(MOE), = Average slant detection range 
Ϊ (MOE), = Average time required to perform a complete APMC 
compensation of the permanent magnetic field of the 
| aircraft 
REFERENCE: Final Report on Project F/0151 FY64 
| "Fleet Operational Investigation of Automatic Permanent 
Magn2tic Field Compensator" 
2 June 1964, CONF. 
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EDC10 - MAD Device 


DESCRIPTION: This equipment is essentially a highly sensitive airborne 
magnetometer designed to detect the magnetic field of a submerged sub- 


marine from low flying aircraft. 
(1) SPECIFIC OBJECTIVE: Evaluate detection capability against submarines. 


(MOE), = Average slant range of detection 

(MOE), = Sweep width 

(MOE), = Probability of detection of a submarine pene- 
trating a standard trapping circle as a function 
of submarine speed and vertical separation between 
aircraft and submarine 
Number_of detections 


" Number of detection attempts 


ASSUMPTIONS: 
(1) When an aircraft attempts magnetic detection of a submarine, the 


distance between the aircraft and the submarine at the point of 
closest approach is regarded as the slant range. 

(2) Average detection range is the maximum range at which, on the 
average, detection can be obtained under a given set of conditions. 

(3) Average slant range of detection is the mean of the average detection 
ranges for all angles of elevation and azimuth of the aircraft from 
the submarine. 

(4) MAD sweep width is a function of two primary factors, namely, the 
average detection range of the MAD installation and the vertical 
separation between the submarine and aircraft. 


REFERENCE: Final Report on Project OP/V126/J15-6 
"Evaluation of the AN/ASQ-8 Magnetic Airborne Detection Set" 


16 June 1955, UNCL. 


B-70 


EDC} 


EDC11 - Electronic Warfare System 

DESCRIPTION: This is a shipboard system which performs the functions of 
electromagnetic signal intercept, analysis, identification, display, ECM, 
and ship command and control system interfacing. 


(1) SPECIFIC OBJECTIVE: Determine surveillance capability against airborne 
radars for given receiver/antenna combination. 
MOE = average maximum intercept range as a function of relative 
bearing 


(2) SPECIFIC OBJECTIVE: Determine range performance in ECM modes. 


(MOE), = Mean DECM (defensive electronic countermeasures) 
burnthrough range 
(MOE), = Mean noise jamming burnthrough range 
(3) SPECIFIC OBJECTIVE: Determine reaction time capability in ECM modes. 


(MOE), = Mean DECM reaction time for given mode of 
operation 
(MOE), = Mean noise jamming reaction time 


ASSUMPTIONS: 

(1) DECM modes of operation are either automatic or machine-assist. 

(2) DECM reaction time is defined as the elapsed time from detection 
of the threat emitter to radiation against the threat emitter. 
Netection time was taken to be the time when emitter activity 
was reported to the computer by the Activity Indicator Module 
(AIM). 

(4) SPECIFIC OBJECTIVE: Evaluate the capability of the system to analyze 
and identify signals. 


(MOE), = Percent correctly identified EMCON violators 
(Number of EMCON a) 


= correctly identified 100 
(Nunber oF Unique Friendly) : 
identifications 


(MOE). = Percent correctly identified EMCON non-violators 
(Paper of EMCON pose) 


= correctly identified 
(Runber oF Unique FriendTy) x 100 


identifications 
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(MOE), = Percent signals identified that were unique 
identifications 


(eee of unique ΕΘ. 

. identifications x 100 
umber of signals 
identified 


(MOE), = Percent signals identified that were ambiguous 
identifications 


2 Number of ambiguous signal identifications . 100 
umber of signals identified 
(MOE). - Percent emitters identified that were unique 


identifications 


ernie of unique eter) 
. ridentifications x100 
(Tiber of ent tters 
identified 


(MOE). = Percent emitters identified that were ambiguous 
identifications 

(Number of ambiguous emits) 

identifications x 100 


* [Number ὁ emitters) 
identified 
(MOE). = Percent of time PRF (pulse repetition frequency) 
7 
was present in unique identifications 
Number of times PRF was present x 100 
Number of unique identifications 
(MOE), = Percent of time PW (pulse width) was present 
in unique identifications 
= Number of times PW was present x 100 
umber of unique identifications 
(MOE), = Percent of time frequency was present in 
unique identifications 
(ee of times eae) 


. \was present 
Roaber of unique identifications * 000 


(MOE), 9" Percent of time scan information was present 
in unique identifications 
(Numer of times scan rere 


« was presen 
umber of unique identifications x 100 
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ASSUMPTIONS: 
(1) Unique identifications include Unique Hostile and Unique Friendly. 


(2) Ambiguous identifications include Ambiguous, Multiple Friendly, 
and Multiple Hostile, all of which require operator resolution 
of the ambiquity. 

(3) Unknown identifications are generic identifications for which there 
is no specific match in the emitter library. 


REFERENCE: Final Report on Project 0/S163 
"Conduct an Operational Evaluation of the AN/SLQ-27 (XN-1) 


SHORTSTOP System" 
12 July 1972, SECRET 


B-73 


EDC12 


EDC12 - ECM Receiving Antenna 
DESCRIPTION: This is an antenna assembly which is designed to permit 
detection, accurate direction finding, and signal analysis when used 
with passive ECM receivers. 


(1) SPECIFIC OBJECTIVE: Determine direction finding accuracy. 


(MOE). = Direction finding error probability, which 
is defined as the probability of OF error 
within ὁ 1σ of the mean DF error. 
ASSUMPTION: A normal distribution of DF error is assumed for 
1 computation of (ΜΟΕ),. 
(2) SPECIFIC OBJECTIVE: Determine signal detection range capability. 


J 

| 

(MOE), = Mean direction finding (DF) error (deg) 
J 


(MOE), = Mean detection range 

(MOE). = Median detection range 

a REFERENCE: Final Report on Project C/S2 FY60 

"Concurrent Evaluation of the Antenna AS-899/SLR" 
. 7 Nov. 1960, CONF. 


oom ott 
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EDC13 - Shipboard Direction Finding System 
DESCRIPTION: This system 1s designed to provide radio frequency (RF) 
spectrum surveillance, intercept and direction finding to surface and 
land-based threat emitters. 

(1) SPECIFIC OBJECTIVE: Determine ability to obtain bearing angles of 

. target emitters. 
MOE = Mean absolute bearing error (deg), which is defined as 
the average absolute difference between the system esti- 


mated bearing angle and an applicable reference bearing 
angle (such as fire control radar, visual or plotted) 


REFERENCE: Final Report on Project 0/S200 
“Conduct an Operational Evaluation of the AN/SRO-19 (XN-1) 


Direction Finding System" 
1974, CONF. 
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EDC14 - Radio Direction Finder 


DESCRIPTION: This equipment is designed to aid nuclear submarines in per- 
forming direction finding on enemy radio signals, surveillance and threat 


assessment. 
(1) SPECIFIC OBJECTIVE: Determine signal intercept capability. 
MOE = Number of tactically significant signals intercepted per 
hour of antenna exposure 


REFERENCE: Final Report on Project 0/S150 
"Conduct an Operational Evaluation of the AN/BRD-7" 


26 June 1970, SECRET 
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EDC15 - Radio Frequency Oscillator (RFO 


DESCRIPTION: The RFO is designed to provide an additional protection for 
ships by denying accurate range information required for sadar directed 
bombing and missile attacks. This is a subsystem to a radar blip enhancer 
and deception repeater countermeasures system used against pulsed radard. 


(1) SPECIFIC OBJECTIVE: Determine the effective ranges and trackbreak 
capability of the countermeasures system against attacking track 
radar systems. 

(MOE), = Average maximum lock-on range for given trackbreak 
mode 
(MOE). = Average maximum trackbreak range for given track- 
break mode 
(MOE), = Average crossover range (i.e., minimum effective 
range) for given trackbreak mode 
(MOE), = Average number of trackbreaks per radar run for 
given trackbreak mode 
~ Number of trackbreaks 
r of radar runs 


REFERENCE: Final Report on Project C/S43 
"Conduct a Concurrent Evaluation of the Radio Frequency 
Oscillator 0-1331 (XN-1)/ULQ-5" 
28 Nov. 1966, SECRET 
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EDC16 - Deception Repeater 
DESCRIPTION: This countermeasures set is a device having potential electronic 
warfare application against enemy search and tracking radars. It is intended 
to present either a false radar target or cause the enemy radar to “break- 
track" or do both. Using it as a target decoy device, a small ship.can 
present a blip comparable to that of a capital ship on the scope of an 
enemy radar. Using it as a track-break (jammer) device to introduce false 
scan modulation, a ship can divert the beam of an enemy's conical scan 
missile control or tracking radar and thereby disrupt his weapon contro] 
solution. 
(1) SPECIFIC OBJECTIVE: Determine effective range capability in various 
modes of operation. 
(MOE), = Average triggering range of deception 
repeater by airborne radar 
(MOE), = Average maximum effective range in target 
decoy mode 


(MOE), = Average minimum effective range in target 
decoy mode 

(MCE), = Average maximum effective range in track- κ 
break mode 

(MOE), = Average minimum effective range in track- 
break mode 

(2) SPECIFIC OBJECTIVE: Determine authenticity cf enhanced radar echoes. 
MOE = Probability of discrimination between decoy 


and true target as a function of range 
Number of times discrimination ὌΝ 


between decoy and true target within a 
iven range band 


re er of decoy and target opportunit 
within a given range band 
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(3) SPECIFIC OBJECTIVE: Determine the capability of performing radar 
deception. 
MOE = Probability of successful deception for given 
mode of operation 


« Number of successful deceptions 
umber of deception attempts 
(4) SPECIFIC OBJECTIVE: Détermine the capability to blank signals from 


friendly radars. 
MOE = Probability of successful blanking 

« .Number of times radar signals were blanked 

lumber 0 anking opportunities 
REFERENCES: (1) Final Report on Project C/S70 

"Evaluate the AN/SLQ-17(V) Countermeasures Set" 
29 July 1971, SECRET 

(2) Final Report on Project 6/S10 FY6) 
"Concurrent Evaluation of Deception Repeaters" 
10 March 1961, CONF. 
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EDC17_- Aircraft Radar/Missile Homing and Warning Receiver 
DESCRIPTION: This system provides aural and visual indications of the 
presence and bearing of threat associated radars, as well as aural and 
visual warnings of surface-to-air missile threats. 


(1) SPECIFIC OBJECTIVE: Provide correct warning indications when operated 
in a multiple tnreat environment against both surface-to-air and 
air-to-air radars. 


MOE = Probability of correct warning indication 
. Number of correct indications 


Number of signals actual ly emitted 


(2) SPECIFIC OBJECTIVE: Provide missile warning during the ingress, attack 
and egress segments of representative strike missions. 


MOE = Percentage of time missile warning was provided 
. lotal time warning observed 
otal test time 
REFERENCE: Twenty-sixth Partial Report on Project F/0210 
"Evaluation of the Charger Blue Equipment Installed in F-4 


Aircraft" 
9 April 1973, SECRET 
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* EDC18 - Radio Frequency Amplifier 


μ DESCRIPTION: This unit is designed to increase the power output of ἃ 

1 countermeasures set which functions as a radar decoy (blip enhancer) 

4 and deception repeater against pulsed radars. 

(1) SPECIFIC OBJECTIVE: Determine abili*y of the system (countermeasures 
4 set) to counter tracking radars for each mode of operation. 

! (MOE), = Average time to lock-on 

att: 


(MOE), = Average time to breaklock 
(MOE), = Burnthrough range, which is defined as the range 
at which the reflected energy is theoretically 
just equal to the countermeasures set signal 
(MOE) 4 = Average number of breaks per run 
(MOE). = Average crossover range, which is defined as the 
minimum effective range 
ASSUMPTION: Barnthrough range is estimated as the range where the last 
᾿ Tock-on occurred. 


; REFERENCE: Final Report on Project C/S52 
"Conduct a Concurrent Evaluation of Amplifier R.F., AM-4530/ 
4 ULQ-6A" 


1 May 1968, SECRET 
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EDC19 - Decoy Repeater Buoy 

DESCRIPTION: This is a buoy mounted version of a countermeasures set 
whose purpose is to create aircraft carrier size radar returns to 
deceive surface search radars. 


(1) SPECIFIC OBJECTIVE: Evaluate deception capability. 


(MOE), = Average maximum range at which an airborne radar 
could receive its own signal returned by the buoy 
for given aircraft altitude 

(MOE). = Average minimum range at which the radar operators 
were not able to discriminate between a large ship 
target and the buoy 


REFERENCE: Final Report On Project F/9 145 FY63 
“Fleet Operational Evaluation of Decoy Repeater Buoy, AN/ULQ-5" 


10 July 1963, CONF. 
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EDC20 - Noise Jammer 


DESCRIPTION: This equipment is utilized on strike aircraft and is designed 
to jam both the elevation and azimuth tracking channels of a surface-to-air 
missile tracking radar. 


(1) SPECIFIC OBJECTIVE: Evaluate the capability of the noise jammer to 
provide protection for a strike aircraft. 


MOE = Percentage of missile miss distances within a given 
range (the lethal radius) of the aircraft 
f(%,. Xos X4) 


ky = jam-to-signal ratio as a function of distance from 
the radar 

Xo = tracking error in elevation as a function of jam- 
to-signal ratio 

Χη = tracking error in azimuth as a function of jam-to- 
signal ratio 


ASSUMPTION: Effectiveness is defined as follows: 


(a) Good - A MOE value of 20% or less 
(b) Fair - A MOE value between 20% to 40% 
(¢) Poor - A MOE value greater than 40% 


DATA REQUIREMENTS SUMMARY : 


ATTACK LABORATORY 
DATA_ITEM EXERCISE SIMULATION 
χη» Xoo Ky X 


REFERENCE: Twentieth Partial Report on Project F/0210 
"Develop Aircraft Tactics Against Surface-to-Air Weapons Sites, 
Evaluation of the ALT-27 in the EKA-3B Aircraft" 
31 May 1972, SECRET 
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Area: Fire Control (FC 


CODE 
FCl 


FC2 


FC3 
FC4 
FC4-1 


FC4-2 


FC4-3 


TABLE B-2 Operational Test & Evaluation 
MOE Data Base (Continued) 


ITEM 


Aircraft Navigation/Weapon Dedivery 
System 


Shipboard Gun Fire Control System 
(Mk 87, Mk 86 Mod 0) 


Underwater Fire Control System (Mk 114) 
Missile Fire Control System 


Shipboard Missile Fire Control Radar 
(AN/SPG-518) 


Airborne Missile Fire Control Radar 
(F-4 AMCS Aero 1A, F-8 AWG-4) 


Shipboard Missile Fire Control System 
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FIRE CONTROL (FC) 
FC] - Aircraft Navigation/Weapon Delivery System 


DESCRIPTION: This is an aircraft bombing system capable of delivering 
sticks of bombs. 


(1) SPECIFIC OBJECTIVE: Determine closest bomb and stick centroid miss 
distances for given stick size and release interval. 
(MOE), = Range error probable (REP), which is defined as 
the median of the absolute values of the range 
error measured from a reference point (namely, 
the intended target) 


(MOE). = Deflection error probable (DEP), which is defined 
as the median of the absolute values of the 
deflection error measured from a reference point 
(namely, the intended target) 


(MOE), = Circular error probable (CEP), which is defined 
as the median miss distance from the target 


HIGHER LEVEL EVALUATION: 
MOE = Probability of target kill for given stick size and 
release interval 
f, (MAE, Xyoeeeoke) for soft targets 
=< fy, (EMO, Xqoree eX) for hard targets 
fy (BEI, Xyoeee eke) for bridge targets 


where 


MAE = mean area of effectiveness, which depends on 
target type, bomb type, damage (or kill) 
criterion and bomb impact angle 

EMD = effective miss distance, which depends on 
target type, bomb type and damage (or ki11) 
criterion 

BEI = bridge effectiveness index, which depends on 
bridge type, bomb type and fuzing type 
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x, = number of bombs per stick 

ratio of the minor axis length of the elliptical 
fragmentation pattern per bomb to the major axis 
length of the elliptical fragmentation pattern 
per bomb 

Xs = stick length 

X4 = stick width 

Xe " CEP of stick centroid (ji.e., (MOE). ) 


(NOTE: The indices MAE, EMD and BEI are given in the Joint 
Munitions Effectiveness Manual (JMEM) and the formulas for 
the MOE, as determined by the functions fy» f, and f3, are 
given by target type in the JMEM.) 


LOWER LEVEL EVALUATION: 


For the case of stick centroid accuracy, 


(MOE), = stick centroid total range error 
(i due to y Ἢ (Ξ due to stick )" 


system/aiming error centroid ballistic 
dispersion 


bomb ballistic 
Σ Rind due to ἡ c ispetsign 
system/aiming error} ( umber of bombs ἐμ 


stick 


(Ss due to ea Ve 
2 


(MOE). = stick centroid total deflection error 
DEP due to 2 _ /DEP due to stick χη" 
* \\ system/aiming error centroid bal istic] | 
dispersion 


2 1,2 


DEP due to individual 
2 bomb ballistic dis- 
" (ee due to + \persion 


system/aiming error Cresta of bombs i) 
stick 
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(MOE), = stick centroid total circular error 


= | /CEP due to 3 + /CEP due to stick ele 
systen/aiming error centroid ballistic 
dispersion 


bomb ballistic dis- 
Ξ (ee due to ) + persion 
system/aiming error {πη of bombs n) 


stick 


(ss due to eae) Ve 
2 


ASSUMPTIONS: 

(1) Stick centroid is defined as the mean point of impact 
of the bombs in the stick. 

(2) Closest bomb in the stick is defined as that bomb 
impact in the stick having the shortest radial miss 
distance from the target. 

(3) For the higher level evaluation, bomb range and deflec- 
tion errors are assumed to be each approximately normally 


distributed. 
(4) For the lower level evaluation, the formulations are valid 
for a salvo (instantaneous) release from the centerline of 


the aircraft. 


REFERENCE: Final Report on Project 0/V¥28E08 
"A-7E Computer Accuracy (MRI Evaluation)" 
6 June 1973, CONF. 
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FC2 - Shipboard Gun Fire Control System 


DESCRIPTION: This is an integrated lightweight system which includes the 
capabilities of continuous air and surface radar search, rapid acquisition 
of targets, simultaneous track on more than one target, and solutions for 
gun orders to simultaneously engage separate targets. 
(1) SPECIFIC OBJECTIVE: Determine surface target detection and tracking 
capability. 
(MOE), = Mean minimum discernible range of a small surface 
target as a function of pulse width 
(MOE). = Mean maximum detection range of a destroyer as a 
function of aspect 
(MOE), = Mean maximum tracking range of a destroyer as a 
function of aspect 
(MOE), = Mean range resolution of two targets while in the 
SEARCH mode 
(MOE). = Mean bearing resolution of two targets while in the 
SEARCH mode 
(MOE), = Percentage of runs on which track was maintained on 


a target in proximity to another target while in the 
TRACK WHILE SCAN mode as a function of ship-to-target 


range and target speed 


(2) SPECIFIC OBJECTIVE: Determine system capability to control gunfire against 


airborne targets. 
(MOE), = Initial salvo error in range for given target 
range band 
(MOE), = Initial salvo error in deflection for given 
target range band 
(3) SPECIFIC OBJECTIVE: Determine system capabil‘ty to control gunfire 
in shore bombardment. 


FC2 


(MOE), = Percent target hits 


« Number of direct hits , 100 
umber of rounds fire 


(MOE). = Mean impact error in range for given target range 
band 

(MOE), = Mean impact error in deflection for given target 
range band 

(MOE), = Initial salvo error in range for given target range 
band | 

(MOE), = Initial salvo error in deflection for given target 
range band 

(4) SPECIFIC OBJECTIVE: Determine the capability of the system to track 
surface radar targets in an ECM environment. 
MOE = Probability of not breaking track in the presence of 
jamming 


“1 - lumber of times jam causes trackbreak 
r of valid runs 


REFERENCES; (1) Final Report on Project C/S48 
"Conduct a Concurrent Evaluation of the Gun Fire Control 
System Mk 87" 
8 April 1970, CONF. 
(2) Supplement to Final Report on Project C/S45 
"Conduct a Concurrent Evaluation of the Gun Fire Control 
System Mk 86 Mod 0" 
4 April 1967, SECRET 
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FC3 - Underwater Fire Control System 


DESCRIPTION: The system is an antisubmarine computing system, providing 

for fire control computations, weapon control outputs, and launcher orders. 
While primarily designed to control] ASROC firing, the system also provides 
fire control data for the control of over-the-side launched torpedo attacks, 
both fixed and trainable hedg2-hog projectors, and provides an aimpoint 
display suitable for use as an aid in controlling DASH attacks. 


(1) SPECIFIC OBJECTIVE: Determine the accuracy of the system's fire control 
solution. 


(MOE), = Mean target course error (deg) based on 
sonar input for given target range band 
and speed interval 

(MOE). = Mean target course error (deg) based on 
radar input for given target range band 
and speed interval 

(MOE). = Mean target speed error (kts) based on 
sonar ‘nput for given target range band 
and speed interval 

(MOE), = Mean target speed error (kts) based on 
radar input for given target range band 
and speed interval 

(MOE). = Mean computer error (yds), which is defined 
as the distance between the location of the 
computer's aimpoint at time of fire and an 
aimpoint graphically reconstructed using 
the same target information available to 
the computer at time of fire 

(MOE). = Mean sonar location error in range (yds) 

(MOE) = Mean sonar location error in bearing (deg) 
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(2) SPECIFIC OBJECTIVE: Determine the accuracy of the system's fire control 
solution as an aid in controlling DASH. 


(MOE), = Mean delivery error (yds), based on a 
comparison of the computed range and 
bearing to the aimpoint, and the actual 
radar range and bearing to the helicopter 
at the launch point 

(MOE), = Mean computer error (yds), which is defined 
as the distance between the location of 
the computer's aimpoint at time of weapon 
drop and an aimpoint reconstructed graphi- 
cally using the same target information 
available to the computer at time of fire. 

(MOE), = Mean target course error (deg) based on 
attack console computation 

(MOE), = Mean target speed error (kts) based on 
attack console computation 


(3) SPECIFIC OBJECTIVE: Oetermine the accuracy of the system's fire control 
solution for over-the-side launched torpedo attacks. 


(MOE), = Mean torpedo launch error (yds), which is 
defined as the distance between the com- 
puted torpedo aimpoint as generated by 
the attack console and the aimpoint at 
which the torpedo was actually fired 

(MOE). = Mean computer error (yds) 

(MOE), = Mean computed target course error (deg) 

(MOE), = Mean computed target speed error (kts) 


REFERENCE: Final Report on Project C/S24 FY62 
"Concurrent Evaluation of the Fire Control System Mk 114" 


3 Dec. 1962, CONF. 
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FC4 - Missile Fire Control System 
FC4-1 Shipboard missile fire control radar 


DESCRIPTION: This shipboard missile fire control] radar is designed to 
track and illuminate both airborne and surface targets. 


(1) SPECIFIC OBJECTIVE: 


Determine target acquisition and tracking capability. 


(MOE), = Mean time to initial acquisition for given 


target altitude 


(MOE). = Mean target πη΄ τ᾽ 3] acquisition range for 


given target altitude 


(MOE). = Acquisition rate (%) 


. Number of targets successfully acquired. 1. 
umber of valid acquisition opportunities 


ASSUMPTIONS; 


(1) 


(2) 


(3) 


REFERENCE: 


Acquisition time is assumed to mean the elapsed time 
between designation of the radar to a designation 
channel and the subsequent reliable acquisition 
(track) of the target by the radar. 

An acquisition was normally considered reliable if 
an "on-target" indication was not followed within 
five seconds by a "not on-target" signal. 
Acquisition range is assumed to be the range of the 
target at the time of reliable acquisition. 


Final Report on Project C/S47 

"Conduct a Concurrent Evaluation of the AN/SPG-51B Radar 
Improved Data Converter" 

30 Aug. 1968, SECRET 


FC4-2 Airborne missile fire control radar 


DESCRIPTION: This fire control radar is part of an airborne missile contro] 
system (AMCS) with the capability of performing radar search, target acquis- 
ition and target track. 
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(1) SPECIFIC OBJECTIVE: Determine system acquisition and tracking capability 
against airborne targets employing countermeasures. 


(MOE), = Probability of successful track of target in 
the chaff only environment 
(mae of successfully tracked targets) 


» sin chaff only environment 
(Nunber of intercept attempts In the chaff) 
only environment 


(MOE), = Probability of lock transfer to chaff in the chaff 


only environment 
με φὼ of times lock transfer to chaff peclrnel) 


« .in_the chaff only environment 
(Number of Intercept attempts in the chaf#) 
only environment 


Ῥ 
J (MOE), = Probability of successful intercept in the noise 
jamming only environment 
] eects of successful target intercepts am 
« ithe noise jamming only environment 


(Roeer of intercept attempts ) 
in the noise jamming only environment 


(MOE) 4 = Probability of noise jammer prog;amming preventing 
target acquisition 
Ἰμρωρῳ of times noise jammer programming pre-) 


« .vented target acquisition 
(Kiaber of atercent attempts in the noise) 
jamming only environment 


(MOE). = Probability of successful track of target employing 
spot or spot sequential noise 
(Rusver of successfully tracked targets ) 
Ξ enploying spot or spot sequential noise 
( umber of intercept attempts in the spat} 
or spot sequential noise environment 
(MOE) = Probability of successfully completed inter- 
cept in the deception only environment 
{τεῦ of successfully completed AlN dg 


= rin the deception only environment 
(Nunber of intercept attempts in the) 
deception only environment 
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(MOE), = Probability of successfully completed intercept 
in the evading target environment 
peal of successfully completed gS EDS) 
« sin the evading target environment 
umber of intercept attempts in t * 
evading target environment 
(MOE). = Probability of successful intercept in the noise 
jamming, chaff and evading target environment 
Ippo of successful intercepts in the noise ) 
Ξ jammed chaff _and evading target environment 
( umber of intercept attempts in the noise \ 
jamming, chaff and evading target environment/ 
(MOE), = Probability of successful intercept in the chaff 
and deception environment 
ρου of successful intercepts in the aka 
. wand decepeion environment 
umber of intercept attempts in the cha ) 
and deception environment 
(MOE). 0" Protability of successful intercept in the chaff, 
noise, deception and evading target environment 
(muaeer of successful intercepts in the chaff, ) 


FC4 


=z \noise, deception and evading target environment 
(Nunber of Intercept attempts in the chaff, ) 


noise, deception and evading target environment 


(MOE), ,* Probability of successful reattack 


τ Number of successful reattacks 
umber of reattack attempts 


(MOE) 1 2" Probability that target countermeasures are 
effective in preventing radar or IR tracks in 
reattack attempts 


Number of times target countermeasures are 
effective in preventing radar or IR tracks 


~ Ain_reattack attempts ἢ 
oes of reattack attempts in the pireertce) 


of target countermeasures 
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(MOE),4 = Probability that target evasive maneuvers are 
effective in preventing successful reattack 
attempts 


Number of times target evasive maneuvers 
are effective in preventing successful 


. sreattack attempts 

( umber of reattack attempts in the ) 
presence of target evasive maneuvers 

(MOE), 4 = Probability that target countermeasures and 
evasive maneuvers are effective in preventing 
successful reattack attempts 


Number of times target countermeasures 
and evasive maneuvers are effective in 


= \preventing successful reattack attempts 
umber of reattack attempts in the 
(resence of target countermeasures and 
evasive maneuvers 


(MOE), 5 = Probability of successful intercept in the 
communications countermeasures only environment 


Number of successful intercepts in the 
communications countermeasures only 
« \environment 
umber of interce-t attempts in the 
communications countermeasures only 
environment 


(MOE) 1 = Probability of successful intercept in the 
combined communications and weapon system 
countermeasures environment 


Number of successful intercepts in the com- 
bined communications and weapon system 
= scountermeasures environment 
umber of intercept attempts in the combine 
communications and weapon system counter- 
measures environment 


ASSUMPTIONS ; 


(1) Sy “deception” is meant angle or range gate deception. 
(2) Intercepts were scored successful if the fighter 


reached final position within the missile launch 
envelope, and the weapon system tracked the target, 
irrespective of tracking mode except boresight, for 
a specified period prior to simulated missile launch 
and throughout the predicted time of missile flight. 


B-95 


Fc4 


(3) Reattacks were scored successful only if completed 
on radar or Air Intercept Controller (AIC) infor- 
mation and cadar track could be maintained for a 
missile launch. 

(4) Communications countermeasures are effective if the 
intelligible reception of the required transmissions 
is prevented. 

REFERENCE: First Partial Report on F/0198 
"F.4 AMCS Aero 1A and F-8 AWG-4 in Single and Combined 
Countermeasures Environments" 
27 Oct. 1966, SECRET 


FC4-3 Shipboard missile fire control system 


DESCRIPTION: This is a shipboard guided missile fire control system (GMFCS) 
which fires a surface-to-air or surface-to-surface missile. 


(1) SPECIFIC OBJECTIVE: Evaluate ability to engage surface launched cruise 
missile (SLCM) raids. 


(MOE), = Percent targets engaged 
« Number of targets engaged x 100 
Number of missile targets 
(MOE), = Percent of attacks in which all targets were 
engaged 
Geet of attacks in which an) 
Ξ (enacts were engages x 100 
umber of missile raids 
(MOE), = Average total engagement time 


(MOE), = Minimum total engagement time 
(MOE). = Maximum total engagement time 


ASSUMPTION: Total engagement time is the time from launch of the 
first SLCM to fire of a shipboard missile at the last SLCM in 
the raid. 


(2) SPECIFIC OBJECTIVE: Evaluate the ability of the system to acquire 
surface launched cruise missile targets for selected acquisition methods. 
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(MOE), = Average acquisition time 
(MOE), « Acquisition reliability 
, Number of missiles acquired 

umber of missile targets 

(MOE), = Cumulative percent acquisitons as a function 
of time 

(MOE), = Cumulative percent acquisitions for given 
range band 


(3) SPECIFIC OBJECTIVE: Evaluate the suility of the system to launch 
missiles against surface launched cruise missile targets. 
(MOE), = Average time from acquisition to initial fire 
(MOE), = Cumulative percent of firings as a function of 
time from acquisition to initiai fire 
(MOE), = Firing success rate (%) 
+ purer of tntersepts a 100 
(MOE), = Firing success rate (%) given an opportunity 
to engage the target 


opportunity for engage- 
ment existed 


(MOE), = Average reaction time from SLCM launch to ship- 
board missile firing 

(MOE), = Median reaction time 

(MOE), = Average refire time 


m 
: targets for which an 


ASSUMPTION: Refire time is the time from fire of a missile with 
one missile fire control] system at the target to fire again with a 
different missile fire control system. 


(4) SPECIFIC OBJECTIVE: Evaluate the ability of the system to acquire 
surface targets. 
(MOE), = Mean detection range 
(MOE), = Mean time to acquire the surface target 
(MOE), = Cumulative percent acquisitions as a function of 
time 
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(5) SPECIFIC OBJECTIVE: Evaluate tracking capability. 

(MOE), = Average initial acquisition range, which is defined 
as the slant range from the project ship to the 
target at the time of initial acquisition 

(MOE), = Average initial acquisition time, which is defined 
as the elapsed time from designazion to GMFCS lock 

(MOE), = Average final acquisition range, which is defined 
as the slant range from the project ship to the 
target at the time of final acquisition 

(MOE), = Average final acquisition time, which is defined as 
the elapsed time from designation to final acquisition 

(MOE). = Tracking quality, which is defined as the percentage 
of time, from initial acquisition to end-of-run, 
during which the GMFCS speedgate was locked-on the 
target 

(MOE) = Acquisition success rate 

= Number of targets acquired 
( er of target acquisit 5) 
opportunities 
ASSUMPTIONS; 
(1) In order to be considered a valid acquisition, the GMFCS lock 
had to be held continuously for at least 10 secs. 
(2) Final acquisition occurred when the GMFCS achieved a lock-on 
which was continuous until the target passed the minimum GMFCS 
tracking range, or turned out-bound (end-of-run). 


REFERENCES: (1) Final Report on Project F/0237 
"Conduct a Fleet Operational Investigation of Tartar 
Weapon System Capability Against Various Threats" 
13 Dec. 1968, SECRET 
(2) Final Report on Project C/S50 
"Conduct a Concurrent Evaluation of the Basic Point Defense 
Surface Missile System as Installed in a Destroyer Type Ship” 
7 Nov. 1968, SECRET 
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TABLE B-2 Operational Test & Evaluation 
MOE Data Base (Continued) 


Area: Infrared and Optical Detection (100 


CODE ITEM 

1001 Infrared Wake Detector 

1002 IR Decoy 

1002 Marine Location Marker (EX-19, EX-20) 
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Infrared and Optical Detection (100 


1001 - Infrared Wake Detector 


DESCRIPTION: This infrared equipment is designed to detect surface wakes 
generated by submarines by presenting to an operator a thermal] picture of 


the sea surface. 
(1) SPECIFIC OBJECTIVE: Determine wake detection capability. 


(MOE), = Average submarine wake persistence time (WPT) 
as a function of sea state 

(MOE) 4 = Average detectable wake persistence time (DWPT), 
which is defined as that portion of the measurable 
wake which can be detected by semialerted operators 
using random crossing angle airplane passes. 


ASSUMPTION: The DWPT, while not directly known, falls between the 
time of last detection and the time of no detection. The ratio of 
the time difference between COMEX and the time over the buoy* on 
last wake detection by either operator, to the measurable WPT was 
determined for each submarine run and these ratios averaged to 
obtain a lower limit. The same procedure was followed using the 
time difference from COMEX to the time over the buoy with first 
"no detectiun"” by both operators to obtain the upper limit. These 
ratios are used to express the limits of DWPT as a percent of WPT. 
(*NOTE: Flashing light buoy, ejected by the submarine, was used 

to mark submarine COMEX.) 


(2) SPECIFIC OBJECTIVE: Determine operator classification capability. 
(MOE), = Probability of correct classification as sub- 


marine 


= Number of correct submarine classifications 
( umber of submarine classification 
opportunities 


στ 


(MOE). = Probability of correct classification as non- 
submarine 


(ienter of correct non-submarine 
classifications ) 

umber of non-submarine classi- 
fication opportunities ) 


REFERENCE: Final Report on Project F/0 143 
(Title Classified) 
3 Jan. 1966, SECRET 
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[002 - IR Decoy 

DESCRIPTION: This is a hand launched flare which is intended to decoy an 

infrared homing antiship missile away from smal] combatants. 

(1) SPECIFIC OBJECTIVE: Determine the capability of a single flare to 
cause an IR seeker to break-lock on a destroyer type ship under 
conditions of various ship IR signatures. 


MOE = Probability of seeker break-lock on ship 
(ee of times flare caused seeker t 


. rbreak-lock on ship 
umber of times seeker locked-on ship 
(2) SPECIFIC OBJECTIVE: Determine capability of a single flare to a decoy 
IR seeker. 
(MOE), = Mean maximum range the IR seeker attained its 
initial lock-on the flare 


(MOE), = Mean maximum range at which the seeker attained 
a tight lock-on the flare 


(3) SPECIFIC OBJECTIVE: Determine capability of an array of flares to 
decoy IR seeker. 
MOE = Probability seeker is attracted to the array of 


flares 
(Meee. of times seeker was attracted to τ 


κ ate of flares 
( r of attempts to attract the see ar 


by an array of flares 


(4) SPECIFIC OBJECTIVE: Determine the capability of an array of flares 
to cause and maintain break-lock on a destroyer type ship. 
MOE = Probability that flare array successfully broke lock 
and maintained seeker decoy 
(eres of times flare array caused Popa 
. »to_break-lock on ship and not reacquire 
( r of times seeker initia y) 
locked-on ship 
REFERENCE: Final Report on Project 0/S165 
(Title Classified) 
10 Feb. 1971, SECRET 
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1003 - Marine Location Marker 


DESCRIPTION: This is an aircraft launched location marker which is designed 
to produce continuous clouds of colored smoke for a fixed period of time. 
(1) SPECIFIC OBJECTIVE: Evaluate visibility of marker. 
(MOE), = Minimum visibility range for given sea state 
(MOE). = Maximum visibility range for given sea state 
REFERENCE: Final Report on Project F/0 134 FY63 
“Operational Investigation of Marine Location Markers 


EX-19 and EX-20" 
6 June 1963, UNCL. 
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TABLE Be2 Operational Test & Evaluation 


Area: Missiles (M) 


MOE Data Base (Continued) 


ITEM 


Air-to-Air Missile (AIM-9C) 


Air-to-Surface Anti-Radiation Missile 
(YAGM-45A . SHRIKE) 


Air-to-Surface Missile (AGM-12B Bullpup) 
Surface-to-Air Missile 
IR Missile (REDEYE) 


Shipboard Surface-to-Air Missile 
(STANDARD) 


Rocket Propelled Ballistic Missile 
System (Mk 1 Mod 0 (TERNE III)) 
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MISSILES (M) 


Ml - Air-to-Air Missile 


DESCRIPTION: This is a supersonic, air-to-air guided missile employing 
semi-active radar head, torque-balance control, and proportional navigation. 
The missile functions in two modes, semi-active and passive. In the semi- 
active mode, the missile homes on the pulsed radar energy emitted by the 
launching aircraft and reflected off the target into the radar seeker. In 
the passive mode, the missile homes on the target's radar jammer. 


(1) SPECIFIC OBJECTIVE: Determine the kill capability against airborne 
targets. 
MOE = Single shot kill probability 


= ROR ὃς RE Re 


where 
Ro = reliability of the launching aircraft radar 


ἢ 


R, 5 missile launch reliability 


Number of successful launches 
umber of va ait mpts to fire 


Re = missile guidance i eliability 
= Number of guidance successes 
umber of successful launches 
Re “5. fuzing reliability 


lethality of the warhead/fuze combination 


LE 
DATA REQUIREMENTS SUMMARY: 
FIRING LABORATORY TESTS, 
DATA_ITEM EXERCISES SIMULATIONS, ETC. 
Ras Rie Re» Re X 
Rie X 


REFERENCE: Third Partial Report on Project C/V1 FY61 
"Operational Evaluation of the AIM-9C (Mk 30) Guided Missile" 
2 Aug. 1965, CONF. 
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M2 « Air-to-Surface Anti-Radiation Missile 


DESCRIPTION: This is a passive air-to-surface missile designed to home on 
radar transmitters. 


(1) SPECIFIC OBJECTIVE: Determine the capability of the system to indicate 
to the pilot whether or not a radar target is radiating. 


(MOE), = Percent of runs on which the pilot was able to 
determine whether or not the primary radar target 
was radiating between the initial point (IP) and 
the pull-up point (PUP) 

(MOE). = Percent of runs on which the pilot was able to 
determine that the primary target commenced 
radiating after the pilot passes IP 

(MOE), = Percent of runs on which the pilot correctly 

i determined that the pulse repetition rate (PRR) 
of the primary target was low (i.e., not in the 
missile firing mode), given that the pilot 
recognized that the primary target was radiating 
between IP and PUP 

(MOE) 4 = Percent of runs on which the pilot correctly 
determined that the pulse repetition rate (PRR) 
of the primary target was high (i.e., in the 
missile firing mode), given that the pilot rec- 
ognized that the primary target was radiating 
between IP and PUP 


(2) SPECIFIC OBJECTIVE: Determine the capability of the system to indicate 
to the pilot whether or not he was being tracked by gun fire control 
radars. 


(MOE), = Percent of runs on which the pilot was able to 
determine that a gun fire control radar was 
tracking the aircraft 

(MOE), = Percent of runs on which the pilot correctly 
determined whether the radar was left, right or 
ahead, given that the pilot recognized that a 
gun fire control radar was tracking the aircraft. 
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(3) SPECIFIC OBJECTIVE: Determine kill capability against radar targets. 


MOE = Single shot kill probability 


= Rag Py 


where 
Raf = missile flight reliability 
Re Re Re 
Py = kill probability against a given target, 
assuming a reliable missile 
R. # launch reliability 


= Number of missiles launched 
umber of launch attempts 


ΒΑ “ guidance reliability 
τ of missiles which setistecter Τὴ 


2 quided to target 
umber of missiles Jaunc 


Re = fuzing reliability 
(teeter of missiles which satisfactorily) 


fuzed 
(Number of missiles which satisfactoriTy) 
guided to target 


DATA REQUIREMENTS SUMMARY ; 


LABORATORY TESTS, 


DATA _ITEM FIRING EXERCISES SIMULATIONS, ETC. 
Res Ros Re χ 
Py x 


REFERENCE: First Partial Report on C/V9 
"Concurrent Evaluation of the SHRIKE Guided Missile System, 
YAGM-45A" 
13 March 1967, SECRET 


B-107 


M3 


M3 - Air-to-Surface Missile 


DESCRIPTION: This is a supersonic air-to-surface, line of sight (LOS) 
radio command guided missile. This missile is designed to be used by 
attack class airplanes against small tactical targets and to permit the 
attacking airplanc to remain beyond the effective small arms envelope. 


(1) SPECIFIC OBJECTIVE: Determine performance against surface targets. 


] 
| (MOE), = Maximum effective slant range as a function of 
launch mode (such as level flight or LOS at 
given dive angle) 
| (MOE). = Circular Error Probable (CEP) about the aim 
point in the horizontal plane through the target 
| (MOE), = Circular Error Probable (CEP) about the aim point 
tn the plane normal to the launch LOS. 
| 


ASSUMPTION: Miss distance is the distance as measured in the plane per- 
pendicular to the line of sight at time of launch and passing through 
the target center. 


REFERENCE: Final Report on Project F/0186 
“Fleet Operational Investigation of AGM-12B (Bullpup) Missile 


] 

System" 
| 2 Feb. 1966, CONF. 
Ϊ 
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M4 - Surface-to-Air Missile 


M4-1 IR missile (REDEYE) 

DESCRIPTION: This is a man-transportable, shoulder fired, surface-to-air 
infrared homing guided missile weapon system used against attacking air- 
craft, including single engine propeller and jet aircraft. 


(1) SPECIFIC OBJECTIVE: Determine tracking capability against air targets 
in the at-sea environment. 


(MOE), = Average tracking error (deg) 
(MOE). = Percent targets successfully engaged 
« Number of targets engaged x 100 
umber of target engaponent) 
opportunities 
(MOE), = Percent of raids on which tracking error was greater 
than the maximum acceptable error 


Number of raids on which tracking error 
was greater than the maximum acceptable 
error 
r of raids engag x 100 


(2) SPECIFIC OBJECTIVE: Determine detection and acquisition capability. 


(MOE), = Mean (visual) detection range 
(MOE), = Mean target acquisition range 
(MOE), = Percent raids visually acquired 


« Number of raids sequined x 100 
Yr of acquisition attempts 
(3) SPECIFIC OBJECTIVE: Determine missile intercept capability. 


MOE = Probability of target intercept within a given altitude 
band - 
. Number of target intercepts 
er of missiles fiire 
REFERENCES: (1) Final Report on Project 0/5126 
"Conduct an Operational Evaluation of the REDEYE Missile 
for Use from PTF Craft Against Attacking Aircraft, to 
Include Single Engine Propeller Aircraft" 
21 Sept. 1967, CONF. 
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(2) Final Report on Project 0/5145 


"Conduct an Operational Evaluation of the REDEYE Weapon 


System" 
23 Oct. 1969, CONF. 


M4-2 Shipboard surface-to-air missile 


DESCRIPTION: 


capability. 


(1) SPECIFIC OBJECTIVE: 


This system is designed to enhance the anti-air warfare 
capability of a surface ship by providing a surface-to-air missile 


against air targets. 


MOE 


Overall success rate 


Re Rep Ror Ror Re, 


launch phase success rate 
Number _of successful launches 


Number of missile launch attempts 
GMFCS and personnel success rate 


Number of valid tests 
umber o ight tests 


missile reliability 
Number of missiles which do not fail 


Number of missiles with an opportunity to home 


homing success rate 
(Maper of missiles which home 2 


a successful intercept 
(Humber of missiles ΠΤ do) 
not fail 


fuze reliability 
bicurag of missiles with ΘΟ ΕΠ 


(liber ΟΡ misst es WiTCN Ταῖς Ba 


successful intercept 


ASSUMPTION: A valid test is assumed to be a test in which the 
specified test environment, test conditions and missile per- 
formance were such that the missile system performance against 
the (simulated) threat coult be evaluated. : 
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Evaluate overall firing capability of the missile 


M4 


(2) SPECIFIC OBJECTIVE: Oetermine intercept capability against airborne 


targets. 

MOE = Overall success rate, which is defined as the prob- 
ability that the shipboard system will not fail either 
before or during missile flight, and that the missile 
will home to a successful intercept with proper fuze 
action, or a direct hit is achieved, killing the target 


* Par F 


sh 

where 

Pa = missile round success rate, which is defined as the 
probability that a missile will home to a successful 
intercept with proper fuze action, or a direct hit is 
achieved killing the target, given that the shipboard 


system functions properly 


Number of missiles which home to a successful 
intercept with proper fuze action, or a direct 
» shit, killing the target 
mber of va missile firings 


Poh = shipboard system reliability, which is defined as the 
probability that a shipboard fire control system wil] 
properly support the missile firing 
(nroer of times the shipboard fire control system 


properly supported the missile firing independent 
of missile success or failure 
lumber of va missile 
undetermined failures 
LOWER LEVEL EVALUATION: 
Par 5 missile round success rate 
= Pre te 


where 
P ie missile reliability, which is defined as the prob- 


r 
ability that a missile will home successfully to 
the vicinity of the intercept region, given that 
the shipboard system functions properly 
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the vicinity of the intercept region and ship- 
« Aboard system functioned properly 

( umber of missile homing attempts when s Pp) 
board system functioned properly 

Ρ 6 = intercept effectiveness, which is defined as the 
probability that a reliable missile, having homed 
to the intercept region with proper shipboard 
system support, will enter region R (a specified 
maximum distance from the target) and the fuze will 
function properly, or the missile will hit and 
destroy the target 


(eee of times the missile al 
. distance did not exceed R 
umber of times missile hom 


(se of times missile homed successfully i 


successfully to the vicinity of the 
intercept region and shipboard syst 
functioned properly 


(3) SPECIFIC OBJECTIVE: Determine guidance capability, 


MOE = Guidance success rate, which is defined as the 
probability that the missile will properly home 
to within a maximum miss distance R from the target 


Number of times missile properly homed 
to within a maximum miss distance R 


= \from the target 
r of guidance attempts 


REFERENCES: (1) Final Report on Project 0/S138 
"Conduct an Operational Evaluation of the STANDARD Missile 
in the TERRIER and TARTAR Weapons Systems" 
1 May 1970, SECRET 
(2) Final Report on Project C/S50 
"Conduct a Concurrent Evaluation of the Basic Point Defense 
Surface Missile System as Installed in a Destroyer Type Ship" 
7 Nov. 1968, SECRET 
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M5_- Rocket Propelled Ballistic Missile System 
DESCRIPTION: The system is designed to deliver a straight line pattern 


of 6 rocket propelled ballistic missiles normal to the computed target 
course. 


SPECIFIC OBJECTIVE: Determine the hit probability of the system against 
non-maneuvering targets. 


MOE = Hit probability = Wee of Satv0 hits 


REFERENCE: Final Report on Project C/S23 FY 62 
| “Concurrent Evaluation of Anti-Submarine Weapon Systen 
: Mk 1 Mod 0 (TERNE III)" 
7 15 Nov. 1962, CONF. 
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TABLE 8.2 Operational Test ἃ Evaluation 


MOE Data Base (Continued) 


Area: Navigation & Guidance (NG 


CODE ITEM 
NG] Shipboard Navigation System (OMEGA Receiver) 
NG2 TACAN Beacon System (AN/URN-20) 
NG3 Submarine Navigation Set (AN/BRN-7 
OMEGA Receiver! 
NG4 


Aircraft Navigation System (AN/APN-126) 


* pel4 


NG1 


NAVIGATION & GUIDANCE (NG) 


NGi_- Shipboard Navigation System 

DESCRIPTION: The system is a Very Low Frequency (VLF) long range electronic 
navigation system using phase comparison of CW signals from two shore-based 
transmitting stations to give a hyperbolic line of position. 


(1) SPECIFIC OBJECTIVE: Evaluate geographic navigational position accuracy. 
MOE = Average (radial) position error (in yards) 


REFERENCE: Final Report on Project C/S21 FY 61 
"Concurrent Evaluation of the Omega Navigation System Utilizing 
the Type II Omega Receiver" 
7 Sept. 1962, CONF. 
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NG2 - TACAN Beacon System 

DESCRIPTION: This is a short range air navigation aid intended for ship 
or shore installation. It transmits signals which provide a properly 
equipped aircraft with distance and bearing information relative to the 
installation. 

(1) SPECIFIC OBJECTIVE: Evaluate system accuracy performance. 


(MOE), = Average distance error as percent of range 

(MOE), = Cumulative distribution of range error as 
percent of range 

(MOE), = Percent of bearing errors within maximum 
acceptable bearing error 


REFERENCE: Final Report on Project 0/S155 
"Conduct an Operational Evaluation of the AN/URN-20 TACAN 


Beacon System" 
25 Aug. 1970, UNCL. 
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NG3 - Submarine Navigation Set 

DESCRIPTION: This receiver is primarily designed to supply the  ubmarine 
with instantaneous navigation information when operating in the OMEGA 

signal environment. Additicnally, it provides a dead reckoning capability 
when no OMEGA signals are received or during submerged submarine operations. 


(1) SPECIFIC OBJECTIVE: Determine navigation accuracy. 


(MOE), = RMS (root-mean-square) error from actual 
position 

(MOE). = RMS error referenced to the time position 

(MOE), = Mean error bias in latitude referenced to 
actual position 

(MOE), = Mean error bias in longitude referenced to 
actual position 

(MOE), = Circular error probable (CEP) about the mean 
bias point referenced to actual position. 


(2) SPECIFIC OBJECTIVE: Determine dead reckoning capability. 
MOE = Mean DR (dead reckoning) radial error (nm) 


REFERENCE: Final Report on Project 0/S170 
"Operational Evaluation of the AN/BRN-7 OMEGA Receiver 


in Submarines" 
2 June 1972, UNCL. 
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NG4 - Aircraft Navigation System 

DESCRIPTION: This is a continuous wave doppler radar navigation system 
designed to provide continuous readouts of track, ground speed, drift 
angle, latitude, longitude and true bearing and great circle distance to 
a selected target and destination. 


(1) SPECIFIC OBJECTIVE: Evaluate system accuracy performance. 


(MOE), = Mean navigation error in range (% distance traveled) 
(MOE). = Mean cross-track error 


ASSUMPTIONS: 
(1) Range error is the component of total error which is parallel to 


the ground track between the target and base. 

(2) Errors in navigation are determined by recording the computed 
latitude and longitude when over the target and comparing them 
to actual latitude and longitude. 


REFERENCE: First Partial Report on Project OP/V261/H 
"Evaluation of the Automatic Navigator AN/APN-126" 
10 May 1960, UNCL. 


B-118 


TABLE B-2 Operational Test ἃ Evaluation 
MOE Data Base (Continued) 


Area: Ordnance (0 


ee ee 8... 


COOE ITEM 
| 01 Bomb Cluster Weapon (CBU-59/B8 APAM, 
Mk 15 Mod 0 SADEYE) 
Ϊ 02 Television Guided Bomb (Walleye Mk 1 Mod 0, 
Walleye II Mk 5) 
03 Laser Guided Bomb (A-6A/RABFAC/Paveway) 
J 04 Aircraft Gun Pod (Mk 4 Mod 0, GPU-2/A) 
05 Rocket (ZAP) 
| 06 Rocket Assisted Depth Bomb (SUBROC) 
07 Mine Hunting and Surveillance System 
| (SEANETTLE ) 
08 Torpedo 
08-1 Wire-guided torpedo (Mk 48 Mod 1) 
J 08-2 Rocket Assisted Torpedo (ASROC) 
08-3 Active/Passive Torpedo (Mk 46 Mod 1) 
| 09 Magnetic Influence Bottom Mine 
(Destructor Mk 30 Mod 0) 
| 
| 
| 
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ORDNANCE (0) 


ΟἹ] - Bomb Cluster Weapon 
DESCRIPTION: This is a cluster weapon designed for use against personnel 
and materiel targets including trucks, light and medium tanks, aircraft, 


and surface warships. 
(1) SPECIFIC OBJECTIVE: Determine weapon delivery accuracy. 


MOE = Circular error probable (CEP) as a function of dive angle 
and delivery mode 


ASSUMPTION: A circular normal distribution of impact points is assumed. 


(2) SPECIFIC OBJECTIVE: Determine bomblet pattern. 


MOE = Percentage of bomblets within the effective 


pattern 
( ee of bomblets falling RETIN 


. the effective Rie 
ro ets in weapon eI 


ASSUMPTION: Due to the inability during testing to locate all (inert) 
bomblets on the ground following any drop, two estimates of this 
percentage can be made. The first, or low estimate, pessimistically 
assumes that al] unobserved inert bomblets fell outside the effective 
pattern; hence the number of observed bomblets falling within the 
effective pattern is divided by the total number of bomblets. A 

second more optimistic estimate assumes that the numbers of unobserved 
bomblets falling within and outside the effective pattern are propor- 
tionad to the observed numbers of bomblets falling within and outside 
the pattern; it is further assumed that the same constant of propor- 
tionality holds for both cases. The estimate of the percentage is then 
obtained by dividing the number of observed bomblets within the pattern 
by the total number of observed bomblets. These two estimates provide 
low and high estimates, respectively, of the true value of the percentage. 


(3) SPECIFIC OBJECTIVE: Evaluate kill capability against surface targets. 
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(MOE), = Mean fractional coverage 
. Pattern lethal area 


Total pattern area. 
(MOE), = Probability of target kill 
- F(Xy 50006 Xe) 
where 
Xy = circular error probable of weapon burst point 

= number of bomblets released 
X3 = target size 
= bomblet lethal radius 
Xs = pattern size 


(NOTE: (MOE), is determined via a computer program 
developed by the Naval Weapons Center. ) 


ASSUMPTION: Pattern lethal area is the sum of the individual 
bomblet lethal areas, counting overlapping portions only once. 


REFERENCES: (1) Final Report on Project 0/¥98 
"CBU-59/B APAM Bomb Cluster Weapon System" 
26 Sept. 1973, CONF. 
(2) Final Report on Project 0/V28, Section A, Task 6 
"Mk 15 Mod 0 SADEYE Weapon System" 
26 March 1968, SECRET 
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02 - Television Guided Bomb 


DESCRIPTION: This is a television guided glide bomb which uses automatic 
video tracking for homing and guidance against visually acquired surface 
targets. 

(1) SPECIFIC OBJECTIVE: Evaluate bomb delivery accuracy performance. 


(MOE), 5 Hit probability 
« Number of target hits 
Number of Beans dropped 
(MOE), = Average miss distance 
(MOE), = Median miss distance 


(2) SPECIFIC OBJECTIVE: Evaluate target acquisition capability. 


(MOE), = Average lock-on range 
(MOE), = Minimum lock-on range 
(MOE)., = Maximum lock-on range 


REFERENCES: (1) Final Report on CNO Project 0/V52 
"Walleye, Mk 1 Mod 0" 
26 March 1968, SECRET 
(2) Final Report on Project F/0263 
"Conduct a Fleet Operational Evaluation of the Guided 
Weapon Mk 5 (Walleye II)" 
14 Dec. 1972, CONF. 
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03 - Laser Guided Bomb 


DESCRIPTION: This is an aircraft delivered bom» which acquires reflected 
laser energy from an illuminated target. 


(1) SPECIFIC OBJECTIVE: Evaluate target acquisition capability. 
MOE = Average normalized acquisition range 


ASSUMPTION: Normalized range, Ry» in meters is computed from 
the equation 


2 
πος ἔπ 
ὯΝ 


where 
R = range (in meters) from target to seeker 


Ε = laser energy (millijoules) 


E, = normalized laser energy (mil lijoules) 


(2) SPECIFIC OBJECTIVE: Evaluate weapon delivery accuracy. 

(MOE), = Circular error probable (CEP) 

(MOE). = Probability of weapon release within envelope as a 
function of CEP for gives ceiling height and release 
conditions 

REFERENCE: Final Report on Project F/0257 
"Conduct of a Fleet Operational Investigation of the A-6A/ 


RABFAC/Paveway Concept” 
5 April 1972, CONF. 
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04 - Aircraft gun pod δὲ 
DESCRIP s is a self-contained gun pod for use on aircraft. 


(1) SPECIFIC OBJECTIVE: Evaluate firing capability against airborne 
targets. 
(MOE), = Percent sorties on which hits occur 


(eaee' of sorties a 
which hits occur x 100 
umber of sorties 


(MOE), = Probability of 100% gun pod fireout 
~ Number of round fired 
umber of rounds attempt 


(2) SPECIFIC OBJECTIVE: Evaluate delivery accuracy of system. 


(MOE), 5 Circular error probable about the target 

(MOE), = Circular error probable about the mean point 
of impact 

(MOE), = Mean point of impact range 

(MOE), = Mean point of impact deflection 


REFERENCES: (1) Final Report on Project 0/V37 
"Operational Evaluation of the Gun Pod, Mk 4 Mod 0 
(F-4 Air-to-Air Phase)" 
17 March 1969, CONF. 

(2) First Partial Repert on Project 0/V95, Phase 1 

“Conduct an Operational Evaluation of the 20mn GPU-2/A 
Lightweight Gun Pod" 
12 June 1973, CONF. 
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05 


Ο5 - Rocket 


DESCRIPTION: This is ἃ hypervelocity, air-launched, free rocket employing 
a flechette warhead accivated by a radar altimeter fuze. 


(1) SPECIFIC OBJECTIVE: Evaluate kill capability against flak sites and 
other light or medium material targets. 


(MOE), = Probability of suppression of an enemy flak site 
(MOE). = Probability of kill against light or medium 
material targets 
(NOTE: These MOE's were computed using simulation models 
developed by the Naval Weapons Center.) 
REFERENCE; First Partial Report on Project 0/V86 
"Conduct an Operational Fvaluation of the ZAP (Zero Anti- 


aircraft Potential) Rocket" 
24 April 1970, SECRET 
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06 _- Rocket Assisted Depth Bomb 
DESCRIPTION: This is a rocket assisted depth bomb fired from a sub- 


marine at a submarine target. 


(1) SPECIFIC OBJECTIVE: Determine the capability to deliver the warhead 


within "lethal" radius of a submarine target. 


(MOE), = Probability of seaworthy impairment for given 
impairment radius as a function of burst depth, 
type of target and target depth 


impairnens/ of , 2 
impairment 0 
(ipa attack error 


1 
1 -(3) 
Probability of mobility impairment for given 


impairment radius as a function of burst depth, 
type of target and target depth 


2 
(‘Spe treene / attack error 


radius 
1 = (3) 


(MOE), = Probability of weapon delivery impairment for given 
impairment radius as a function of burst depth, 
type of target and target depth 


Weapon delivery /CEP of ἕξ 
) impairment radius/ attack error | 


(MOE), 


»7-} 


ni— 


LOWER LEVEL EVALUATION: 


CEP of attack error = median attack error, which jis the 
difference between actual point of 
detonation and actual target 
position at time of detonation 

- ἔ(Χ7.»0. 0 Xe) 
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where 


x = missile delivery error, which is defined as the 
difference between the actual point of detonation 
and the computed aimpoint (i.e., the detonation 
point) 

aimpoint error, which is the difference between 
the correct aimpoint for the existing solution 
and the aimpoint set into the missile 

prediction error, which is the error in computing 
the correct aimpoint resulting from an incorrect 
target course and speed solution 

location error, which is the difference between 
the position of the target at time-of-fire (TOF) 
by fire control solution and the actual target 
position at TOF 

maneuver error, which is the error resulting from 
the target not making good its actual TOF course 
and speed 


=< 
a 


»- 
. 


=< 
[1 


ASSUMPTIONS: 


(1) 


(2) 


Probability of seaworthy impairment is a measure of 
damage which a submarine's hull can withstand and 

still allow the submarine to remain afloat. The level 

of seaworthy impairment is that damage to the hull 
sufficient to cause the submarine to be in danger of 
settling to the bottom. Seaworthy impairment radius 
refers to the range from the target at which a detonation 
will produce this level of damage. 


Probability of mobility impairment is a measure of the 
damage to a submarine's ability to maneuver. The level 
of mobility impairment is that damage sufficient to 
cause the submarine to lose steerage in a desired 
direction. Mobility impairment radius refers to the 
range from the target at which a detonation will pro- 
duce this level of damage. 
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(3) Probability of weapon delivery impairment is a measure 
of the damage to a submarine's fire contro], sonar, or 
Taunch equipment such that the capability to success- 
fully and accurately launch its store of weapons is 
curtailed or reduced. The level of weapon delivery 
impairment is that damage sufficient to cause a low 
probability of weapon launching and a corresponding 
lower probability of successful detonation in the target 
area. Weapon delivery impairment radius refers to the 
range from the target at which a detonation will produce 
this level of damage. 

Attack error is the vectorial sum of the missile delivery 
error, aimpoint error, prediction error, location error 
and maneuver error. 

(5) The distribution of attack error is circular normal. 


DATA REQUIREMENTS SUMMARY: 


(4 


——_ 


ATTACK WEAPON TESTS, 


DATA ITEM EXERCISES LABORATORY TESTS, ETC. 
Attack error X 
Seaworthy impairment radius 
Mobility impairment radius X 
Weapon delivery impairment X 
radius 


REFERENCE: Final Report on Project (7517 
"Concurrent Evaluation of the SUBROC Weapon System" 


21 Jan. 1966, SECRET 
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07_- Mine Hunting and Surveillance System 

DESCRIPTION: A torpedo shaped, wire guided, self-propelled underwater 
vehicle designed to neutralize bottom mines through the detonation of a 
self-contained warhead is used in conjunction with a mine hunting sonar for 
mine neutralization without the use of underwater swimmers. 


(1) SPECIFIC OBJECTIVE: Determine mine hunting and clearance performance. 


(MOE), = Probability of mine neutralization given 
correct classification 


(Heer of correctly Nese) 
mines neutralized 


" “Number of mines correctly classified 
(MOE). = Probability of mine correct classification 
given detection 
(vest of detected mines correct iy) 
~ classified 
Number of mine detections 
(MOE), = Percent of total mines in field success- 
fully neutralized 


« Number of mines neutralized. 1700 
er of mines in field 


(MOE), = Mean range at which the contacts were 
classified as minelike or non-minelike 
(MOE). = Mean time expended per non-minelike contact 
(MOE) ¢ = Mean time expended per minelike contact 
(MOE), = Mean time expended in classifying a contact 
as minelike 
(MOE), = Average mine field clearance rate 
Mine field area 


" Total time spent in area 
(MOE), = Probability of hit as a function of water 
depth and sonar range 
cet of hits for given depth sean) 


= sand sonar range band 
er of runs 
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(2) SPECIFIC OBJECTIVE: Determine reattack performance. 
MOE = Percent of attempted reattacks which were 


successful 


. Number_of successful reattacks . 100 
umber of reattack attempts 


(3) SPECIFIC OBJECTIVE: Determine warhead detonation performance. 


MOE = Percent of attempted warhead detonations 


which were successful 


~ Number of successful warhead detonations χ 100 
er of attempted warhead detonations 


(4) SPECIFIC OBJECTIVE: Determine vehicle placement accuracy. 
MOE = Average radial miss distance between contact and intended 
impact point 


REFERENCE: Final Report on Project 0/S108 
"Conduct an Operational Evaluation of Mine Hunting and 


Surveillance System S2602, SEANETTLE Subsystem" 
6 Jan. 1967, CONF. 
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08 - Torpedo 
08-1 Wire-guided torpedo 


DESCRIPTION: This is a wire-guided weapon with an active/passive system 
for use against submarines and surface ships. 


(1) SPECIFIC OBJECTIVE: Determine performance against submarine and surface 
ship targets. 


MOE = Probability of mission success (MOMS) for given target 
type, target depth, target speed, target tactic 
(evasion or no evasion) and torpedo search speed 


SPR, Be bask PL Poy BoP IP 


where 
= probability of detection given a target 
. Number οὐ target detections 
" Number of target detection opportunities 
P_ = probability of correctly classifying the target 
given target detection 
(hase of correct Chess cay thet 
. of detected targets 
umber of target detections 
P. = probability of obtaining a fire control solution 


given classification and decision to fire 
bere! of times a fire control sorte 60) 


was obtained on a classified target 
er of attempts to obtain a fire 
control solution on a classified target 
once the decision was made to fire 
P_ = probability of torpedo enable given a decision to fire 
« Number of times torpedo enabled 
umber of torpedo enable attempts 
P_ = probability of torpedo acquisition given torpedo 
enable 


. Number of times torpedo acquired target 
(umber of acquisition attempts for’ 
an enabled torpedo 
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ee = probability of torpedo validation given torpedo 
acquisition 
. Number of times torpedo validation occurred 
(Number of torpedo validation abeaapts) 
when target was acquired 
“Ἐπ = probability of reaching close-in attack given 


torpedo validation 


« Number of times close-in attack is reached 
‘Number of close-in attack attempts w wn 
( torpedo validation has occurred 


τ = probability of reaching exploder actuation range 
given close-in attack 


[tunoer: of times exploder actuation range) 
is reached 


2 (Muster of attempts to reach exploder 


actuation range in close-in attacks 

P| # probability of exploder actuation given 
exploder actuation range is reached 

~ Number of exploder actuations 
( umber of exploder actuation λον, 
within exploder actuation range 

= probability of acceptable target damage 
given exploder actuation 
(nueret of times acceptable target seed) 


= .occurred upon exploder actuation 
umber of exploder actuations 


HIGHER LEVEL EVALUATION: 
MOE = (MOMS) x (R) 


where 
R = torpedo in-water reliability 


= Number of torpedoes that ran as pregame’ 
Number of torpedoes that are ljaunc 


DATA REQUIREMENTS SUMMARY; 
WEAPON TESTS, LABORATORY 


ATTACK TESTS, COMPUTER SIMULA- 
DATA_ITEM EXERCISES TIONS, ETC. 
Par Por Ps Pa? Pp Pye Pai χ 
Pat Poo Pr. X 
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REFERENCE : 


Final Report on Project 0/S167 


"Torpedo Mk 48 Mod ] Operational Evaluation" 
21 Sept. 1972, SECRET 


08-2 Rocket assisted torpedo (ASROC) 
DESCRIPTION: 


targets. 


This is a rocket assisted torpedo used against submarine 


(1) SPECIFIC OBJECTIVE: Determine the capability of the weapon system 
against submarines. 


(MOE), = Probability of hit 


. Number of hits 
Number of torpedoes fired 


(MOE) » = Total attack error (median), which is defined 


as the distance between the weapon water entry 
point and the aimpoint based on the target's 
actual position, course and speed at the time 
of weapon water entry 


LOWER LEVEL EVALUATION: 
(MOE)5 = (X25... 4X5) 


where 


prediction error, which is defined as the error 

in aimpoint caused by an incorrect solution for 
target course and speed at time of fire 

evasion error, which is defined as the error 
resulting from evasive maneuvers of the target 
between time of fire and time of weapon water entry 
ballistic error, which is defined as the horizontal 
distance from computed aimpoint to the point of 
weapon water entry 

sonar location error, which is defined as the 
horizontal distance from the actual position of 

the submarine to the position of the submarine as 


determined by sonar at the time of fire 
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X 


5 


= computer error, which is defined as the difference 
between the computed aimpoint generated by the 
computer and the aimpoint determined graphically 
using the computer's solution for target course 
and speed 


(NOTE: (MOE). is the vectorial sum of the prediction, 
evasion, ballistic, sonar location and computer errors.) 


REFERENCE: 


Second Partial Report on Project C/S4 FY60 


"Concurrent Eva’:2tion of the ASROC Weapon System Using 
the Rocket Thrown Torpedo Mk 2" 
29 May 1961, CONF. 


08-3 Active/passive torpedo 


DESCRIPTION: This is a high speed, active/passive homing device capable 
of detecting and homing on submarines. 


(1) SPECIFIC OBJECTIVE: Determine performance and acquisition capability 
against both submarines and mobile acoustic targets (MOACT). 


(MOE), = Overall acquisition probability 


« Number of runs on which torpedo acquired target _ 
umber of runs valid for overall acquisition 


(MOE), = Overall attack probability 


(eres of runs on which the torpedo διε ΠῚ 


= ithe target to hit or to turnawa 
Number of runs valid for sare attack 


(MOE). = Conditional acquisition probability 


(NOTE: 
occurring before an acquisition at a time when acquisition 
and attack were ccnsidered probable. (MOE), is a measure 
of torpedo acquisition performance in the absence of 
destructive malfunctions.) 


« Number of runs on which torpedo acquired target 
Number of runs valid for overall! acquisition, 
excluding those runs which experienced type A 
malfunctions 


A type A malfunction is a destructive malfunction 
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(MOE), = Conditional attack probability 
(Miaber of runs on which the torpedo 
. attacked the target to hit or to turnaway 
umber of runs valid for overall attack, 
excluding those runs which experienced 
type A or B malfunctions and those runs 
on which the torpedo did not acquire the 
target 
(NOTE: A type B malfunction is a destructive malfunction 
occurring before an attack, but after at least one acqui- 
sition, at a time when attack was still considered possible. 
(MOE), is a measure of torpedo attack performance, given 
prior acquisition, in the absence of destructive malfunctions. ) 


REFERENCE: Final Report on Project C/C] 
"Concurrent Evaluation of the Torpedo Mk 46 Mod 1" 


17 Oct. 1966, CONF. 
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09 - Magnetic Influence Bottom Mine 

DESCRIPTION: This is an aircraft-planted, magnetic influence bottom mine 
intended primarily to interdict indigeneous small craft carrying war 
material on inland waterways. It can also be dropped on land for use as 
an anti-vehicle and anti-personnel mine. 


(1) SPECIFIC OBJECTIVE: Determine the response of the device to small craft. 


(MOE), = Probability that the device will actuate when a 
small-boat target passes directly over 
(umes of times device actuated in FeSpOTEG) 

= to ἃ _small-boat target Sart 

Number of valid runs 

(MOE). = Probability that the device will actuate within 
moderate damage range in response to a boat target 
{πεῖ of times device actuated within moderate 


= damage range in response to a boat target 
umber of valid runs 


(MOE) 4 = Probability of actuation versus lateral range 
for given boat target 


(2) SPECIFIC OBJECTIVE: Determine the response of the device to vehicles 
crossing a bridge. 
MCE = Probability that the device will actuate and do 
at least moderate damage to a vehicle passing 
over a bridge when planted in a swamp close to 
the bridge 


Number of times device actuated within moderate 
damage range in response to a vehicle passing 


plover arb die τ θπ-  ς 

Number of valid runs 

(3) SPECIFIC OBJECTIVE: Determine the response of the device to vehicles 
on land. 


MOE = Probability that the device will actuate within 
moderate damage range in response to a vehicle 
when planted on land 
(AUnneR of times device actuated within pose lene) 


. \damage range in response to a vehicle 


~ “Number of valid runs 
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REFERENCE: Final Report on Project C/V14 
"Concurrent Evaluation of the Destructor Mk 30 Mod 0" 
12 Feb. 1968, SECRET 
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TABLE B-2 Operational Test & Evaluation 


MOE Data Base (Continued) 


Area: Submarines (S 


CODE 


ITEM 


Submarine 
(Submarine in Fixed Barrier Mission) 
(Submarine in Area Search Mission) 


(Submarine in Surveillance Aided 
Intercept Mission) 
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πὶ ess oi 


οἷ 


SUBMARINES (5) 


5] - Submarine 
S1-1 (Submarine in Fixed Barrier Mission) 


DESCRIPTION: The Fixed Barrier Role is one in which an SSK is assigned 
a patrol area and the responsibility to detect and kill any enemy sub- 
marines that may be encountered in the area. 


(1) SPECIFIC OBJECTIVE: Detect and kill any enemy submarine encountered. 
MOE = SSK versus Transitor effectiveness (STE) 


= P,P. P Ρ 


0 Pc Pay Pao Px 


P. = probability that the SSK detects a transiting sub- 
marine without first being killed, given a detection 
opportunity 
D _ Number of detections of a transitor by the SSK 

" § * Nunber-of valid detectton oppartunieles for the Sok 

P. = probability that the SSK correctly classifies ἃ trans- 

iting submarine without being killed between the tine 

of detection and time of classification, given that 


the transitor has been detected 


aga of correct classifications of Hg) 
transitor by the SSK 


Number of detections of the transitor by 
the SSK that are valid opportunities for 
classification 

probability that the SSK makes an attack against a 
transiting submarine without being killed between the 
time ov classification and attack given that the 
transitor has been correctly classified 


{86 Γ of attacks made by the SSK aga NSE) 
Al _ ‘the transitor 
com (trans of correct classifications of a) 


C 
ῦ 


ΑἸ 


transitor by the SSK that are valid 
approach opportunities 
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Pa2 * 


Ό 
" 


probability that the SSK conducts an accurate attack 
(i.e., accurate placement of the weapon as evaluated 
when the weapon approaches the target and not at time 
of fire) against a transiting submarine without being 
killed between the time of attack and the time the 
launched weapon no longer requires control dy the fir- 
ing ship for successful culmination of the attack, 
given that an attack is made 


{πΡῈῚ of accurately placed attacks by {ΠῚ 
A2 _ SSK against the transitor 
AT Number of attacks made by the SSK against 
(he transitor that are valid for oahu 
attack accuracy 


probability that a transiting submarine is destroyed, 
given that an accurate attack is made 


K . Number of transitors killed by the SSK 


* Re (pianibes of accurately placed attacks bY) 


.the SSK against the transitor 


LOWER LEVEL EVALUATION: 


Pao * 


probability of accurate attack 
‘ " 

(Pe Pap * OF Pap) Ps 

probability of an accurate fire control solution at 

time of fire, given that an attack is made 


1 - Pe 


probability of an accurate placement, given satis- 
factory torpedo performance through the placement 
point and an accurate fire control solution at TOF 
probability of an accurate placement, given satis- 
factory torpedo performance through the placement 
point and an inaccurate fire control solution at TOF 
probability of satisfactory shipboard system perfor- 
mance, given that an attack is made 
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ASSUMPTIONS: 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


A valid detection opportunity is defined as a transiting 
enemy submarine entering the SSK patro] area. Accord- 
ingly, when all transitors pass through the SSK patrol 
area, all transits are detection opportunities. 

A detection is defined as occurring when the SSK gains 
contact on the transitor. 

Correct classification of the transitor occurs when 
the SSK correctly identifies a sonar contact as an 
enemy submarine. 

An attack is defined as occurring with the simulated 
or actual launch of one of more weapons. 

An accurate attack or accurately placed attack for 
actual torpedo firings is defined as one during which 
the target passes through the acquisition cone of the 
torpedo as it approaches the target; for simulated 
firings, one for which a torpedo would have reached 
theoretical acquisition range by following the pro- 
grammed run, including wire guidance commands. 

A kill is defined as occurring when an attack would 
have resulted in an actual kill had a warshot weapon 
been used. 


DATA REQUIREMENTS SUMMARY: 
DATA_ITEM DATA SOURCE 


0 


Determined by comparing the bearing of sonar 
contacts contained in the SSK's Sonar Contact 
Logs and the Commanding Officer's Narrative 
with the bearing of the transitor on the 
reconstructed track. 


ς Obtained from analysis of the Sonar Contact 
Log and/or Commanding Officer's Narrative. 

Al Obtained from the Commanding Officer's 
Narrative and/or the submitted attack records, 

A2, K Determined during reconstruction, 
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(NOTE: In this development, al] of the data may come from a 
set of transits such that D in the numerator of Py 
is the same as the D in the denominator of Pos etc. 
However, this is not a necessary condition for use 
of this model; i.e., the data sample used for one 
phase can be different from the data sample used in 
the succeeding phase. An example of how this is 
likely to occur is as follows: An exercise transitor 
is detected, classified, and tracked. During the SSK's 
approach the exercise transitor experiences a casualty 
and goes out of action for several hours. The inter- 
action is valid for detection and classification, but 
invalid for approach and attack. Hence, in this case, 
the C in the denominator of Pay is one less than the C 
in the numerator of Pee) 


REFERENCE: “Submarine Analysis Notebook" 
Commander, Submarine Development Group Two 
Sept. 1973, CONF. 


S1-2 (Submarine in Area Search Mission) 


DESCRIPTION: Ownship is assigned the task of seeking out and destroying 
an enemy submarine in a designated ocean area, given the target location 
is unknown. There is a considerable range of tactical options available 
to the searcher, e.g., choice of search pattern, mode of sonar operation. 
The searcher may sweep through the search area overtly, j.e., radiating 
sufficient noise to lure a target into an attack position. Alternately, 
the searcher may use a covert search, attempting to detect and kill a 
target while remaining undetected. This latter type of search is more 
prevalent at present. 


(1) SPECIFIC OBJECTIVE: Detect and kill the target submarine. 


MOE = Area Search Effectiveness (ASE) 
= Probability that own ship will detect and kill a target 
submarine at or before time t, given that a detection 
Opportunity begins at time 0 and continues without 
interruption through time t 
= Pc(t) Po Pay Pao Px 
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P(t) 


Al 


A2 


probability that a target is detected and is killed 
at or before time t, given that a taryet is killed 


n 

at " " e(-t/t) Σ (5.10) 
probability that own ship correctly classifies the 
target without being successfully counterattacked 
between time of detection and classification, 
given a detection 
C . Number of correct classifications by own shi 
δ (lunber oF detectTons by awn ship that are) 

valid opportunities for classification 
probability that own ship makes an attack without 
being successfully counterattacked between time 
of classification and attack, given correct 
classification 


Al , Number of attacks made by own shi 

ee umber of correct classifications by 
own ship that are valid approach 
opportunities 


probability that own ship conducts an accurate 

attack (i.e., accurate placement of the wecpon 

as evaluated when the weapon approaches the 

target and not at time of fire) against a target 

submarine without being successfully counterattacked 

between the time of attack and the time the launched 

weapon no longer requires control by the firing ship 

for successful culmination of the attack, given 

that an attack is made 

A2 _ Number of accurately placed attacks by own shi 

RY " (Wunber of attacks nade by om ship that are) 
valid for evaluating attack accuracy 

probability of a kill, given that an accurate attack 

is made 

K_, Number of kills by own shi 

RE" (Munber of accurately placed attacks 


by own ship 
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- time for which ASE is being estimated 
number of complete runs 
= exercise mean time-to-detection 


“5. 
" 


Sum of search times 


*  ¥otal number of detections — 

5, = length of the time interval between detection and 
kil] on a complete jth run; ordered such that 
$424 554 S54 44 

= number of complete runs on which the interval 
between detection and kill was less than t, j.e., 


n is such that ss oD +] 


ASSUMPTIONS : 
(1) A detection opportunity exists whenever both the 


(2) 


(3) 


(4) 


(5) 


(6) 


searcher and target are in the designated search 
area. 

A detection is defined as occurring when the searcher 
gains contact on a target. 

Correct classification of the target occurs when the 
searcher correctly identifies a sonar contact as an 
enemy submarine. 

An attack is defined as occurring with the simulated 
or actual launch of one or more weapons. 

An accurate attack or accurately placed attack for 
actual torpedo firings is defined as one during which 
the target passes through the acquisition cone of the 
torpedo as it approaches the target; for simulated 
firings, one for which a torpedo would have reached 
theoretical acquisition range by following the pro- 
grammed run, including wire guidance commands. 

A kill is defined as occurring when an attack would 
have resulted in an actual kill had a warshot weapon 
been used. 
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NATA REQUIREMENTS SUMMARY : 


OATA_ITEM 
υ 


DATA_SOURCE = 

Determined by comparing the bearing of sonar 

contacts contained in the Sonar Contact Logs 

and the Commanding Officer's Narrative with 

the bearing of the target on the reconstructed 

track. 

Obtained from analysis of the Sonar Contact 

Log and/or Commanding Officer's Narrative. 

Obtained from the Commanding Officer's 

Narrative and/or the submitted attack records. 

Determined during reconstruction. 

Determined during reconstruction. If detec- 

tion is gained on the ith run before the 

searcher enters the search area, then τ 20. 

Determined during reconstruction as the inter- 

val between detection and the predicted or 

actual impact of a simulated weapon or real 

weapon, respectively. 

(NOTE: In this development, al] of the data may come from a 
single exercise such that C in the numerator of Pe 
is the same as the C in the denominator of Pare etc. 
However, this is not a necessary condition for use 
of this model; i.e., the data sample used for one 
phase can be different from the data sample used in 
the succeeding phase. An example of how this is 
likely to occur is as follows: A target is detected, 
classified, and tracked. During own ship's approach 
the target experiences a casualty and goes out of 
action for several hours. The interaction is valid 
for detection and classification, but invalid for 
approach and attack. Hence, in this case, the C in 
the denominator of Pal is one less than the C in the 
numerator of Po: However, some complete runs are 
needed in order to determine the times S,..) 
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REFERENCE: "Submarine Analysis Notebook" 
Commander, Submarine Development Group Two 
Sept. 1973, CONF. 


S1-3 (Submarine in Surveillance Aided Intercept Mission) 


DESCRIPTION: A search area of sufficient magnitude is such that own ship, 
using its own detection capability, would have difficulty in detecting an 
on-station or transiting target in a timely manner. Intelligence about 

the motion of the target, gained by an outside surveillance system, is 
transmitted to the submarine, which then attempts to intercept (close, 
detect, and classify) the target. Intercept is considered successful if 

the submarine attains a position relative to the target which {s suitable for 
its ultimate objective (kill, general or close surveillance, etc.). The 
success of own ship depends directly on the effectiveness of target localiza- 
tion, and the command and control efficiency of the surveillance system. 


(1) SPECIFIC OBJECTIVE: Close, detect and classify a submarine target 
with the aid of a surveillance system. 


MOE = Surveillance Aided Intercept Effectiveness (SAIE) 
= Probability that the submarine will covertly detect, 
classify and close a target detected by a surveillance 
system, and designated for intercept, utilizing 
localization information from the surveil lance 
system in real time 


=P, [Pr [Pp Pps Poy ὁ (I-Pa) Pool + £(1-Py) Pyg]| Po-P 


where 
PL = probability that the surveillance system localizes the 
target at least once, given an opportunity 
eae 
No 


Pr = probability that the current surveillance localization 
1s effective, given that at least one localization 
occurs. (Effective localization is not defined in an 
absolute sense; rather, the analyst evaluates each 
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01 


run. Localization is considered to be non-effective 
if it is evaluated as insufficient to effect an inter- 
cept by the submarine. ) 


Ν᾿ 

an 

probability that own ship utilizes the current 
localization, given that an effective localization 
was obtained 

"R 

Ny 

probability that own ship attains search position, 
given that he utilized the current data 

Np * Sy 

probability that own ship detects the target, given 
that he attained search position 

Noi * “be 


ΡΤ Ὁ 


Poe = probability that own ship detects the target, 


“Hl 


Po3 


given that he did not utilize the current 
effective localization 


R 
probability that own ship detects the target, 


given that the localization is non-effective 


“7 


Ae, 


= probability that own ship correctly classifies the 


target without being successfully counterattacked 
between time of detection and classification, given 
a detection 


- 


= 
xz 
a 


= 
[ 


probability that own ship makes an undetected 
approach to a suitable position for kill or for 
initiating surveillance, given that a correct 
classification exists 


Nq 
Nc 
number of opportunities (exercise runs) 

number of exercise runs on wnich at least one sur- 
veillance localization occurs 

number of exercise runs on which the current local- 
ization is effective (the target's position is within 
own ship's search area) when the target is detected, 
or own ship enters the search area, or the target 
reaches CPA, and own ship is not in the search area 
the number of exercise runs on which own ship had 
correctly received and utilized the current effective 
localization 

the number of exercise runs on which own ship com- 
mencecd a search of the area based on effective 
localization prior to detection of the target 

the number of exercise runs on which own ship detects 
the target while enroute to a search area based on 
effective localization, and the target is contained 

in the search area 

the number of exercise runs where own ship detects 

the target within the search area while conducting a 
search of the area 

the number of exercise runs on which own ship detected 
the target while acting on localization data that is 
either outdated (more recent effective localization 
has occurred, but has not been received) or that has 
been garbled in transmission, or has been erroneously 
evaluated 
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Noa = the number of exercise runs on which own ship detected 
the target while acting on localization data that was 
non-effective 


Ne 


= the number of exercise runs on which own ship correctly 


classifies the target 


Na = the number of exercise runs on which own ship completes 


ASSUMPTIONS : 
(1) 


(2) 


(3) 


(4) 


an undetected approach to a position relative to the 
target from which he may carry out his assigned 
combat role 


An exercise run is that period of time during which the 
target proceeds along a designated track through an 
assigned patro? area at such a speed or in such a 
condition that detection by the surveillance system is 
likely. 

A surveillance localization is said to occur if and when 
the assisting surveillance system supplies the Submarine 
Operational Control Authority (OPCON) with an estimate 
of target position, heading, speed, and a corre- 
sponding measure of confidence in each, at any 

time during an exercise run. 

Own ship's assigned search region is generally a 
square area, centered on the reported target's 
position, oriented such that one pair of sides are 
parallel to the course vector, and which moves with 
time along the target's reported PIM vector. The 
search region is reset with each updated localization 
reported by the surveillance system, and the DR 
restarted from the new localization position and along 
the new PIM received. 

The target is said to be contained within the search 
region; or, conversely, the surveillance localization 
is said to be effective if one of the following con- 
ditions exists: 
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(5) 


(6) 


REFERENCE: 


(4.a) If own ship detects the target when the target 
is within the search region. 

(4.b) If own ship attains (defined below) the search 
region and the target is within the search 
region. 

(4.c) If own ship neither detects, nor attains, and 
the target is within the search region at the 
time of CPA. 

An effective localization is utilized by own ship if 

the localization information has been: 

(5.8) Received without garbles, plotted correctly, 
and is the basis for subsequent action by own 
ship. 

(5.b) Received garbled, recognized as incorrect, 
proper correction applied, plotted correctly, 
and used as above. 

Own ship is said to attain a desired position within 

the search region if either of the following conditions 

exists: 

(6.a) Own ship enters the search region prior to 
detecting the target. 

(6.b) Own ship aetects the target while enroute to 
the search region, and the target is contained 
within the search region. 


"Submarine Analysis Notebook" 
Commander, Submarine Development Group Two 
Sept. 1973, CONF. 
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TABLE B-2 Operational Test ἃ Evaluation 
MOE Data Base (Continued) 


Area: Surface Ships (SS 


CODE ITEM 

55] Destroyer 

595]-] (Destroyer in Close-In Screening 
Mission 

$$1-2 (Destroyer in Barrier/Search Attack 
(SAU) Mission) 

$$1-3 (Destroyer in Passive Barrier/Cold war 
Submarine Hold-Down Mission) 

$$1-4 (Destroyer Using Jezebel) 

552 sg ἀνὰ μὰ Assault Ship (LPH-2, Sea Control] 

p 
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55] 


SURFACE SHIPS (SS) 


59] « Destroyer 
SS1-1 (Destroyer in Close-In Screening Mission) 


DESCRIPTION: A close-in destroyer screen attempts to prevent an enemy 
submarine from penetrating the screen and gaining a position to launch 
a torpedo attack on a protected high value unit (HVU). 


(1) SPECIFIC OBJECTIVE: Prevent a single submarine penetrator from 
attacking a protected merchant convoy or task force. 


MOE = Destroyer Screen Effectiveness 
= Probability that a single submarine is prevented from pene- 
trating a close-in destroyer screen and gaining position to 
launch a torpedo attack on a high value unit (HVU) 


= Povo evo Patve Payat PK/H 
where 
Po/0 = probability of detection given an opportunity 
D (piste of valid detections by τ) 
ΤΊ, \destroyer screen 
Ὁ ( umber of penetrations attempted, ἴ.6., ) 
number of valid screen detection opportunities 
PE/D = probability of engagement given detection 
E (eee of valid submarine detections that are} 
=» lL. ‘engaged by the destroyer screen 
δ; ( umber ΟΥ̓ valid screen detections that ate) 
valid opportunities for engagement 
PAT/E* probability of attack given engagement 
A ΠΡ of "yes" decisions for a screen 
=»  , ‘destroyer to attack the penetrating submarine 
ED ( umber of screen engagements that are valid 
attack decision opportunities for the 
\destroyer screen 
PusAT™ probability of hit given attack 
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(eaeber of valid "yes" decisions to attack) 


Ἂν A de , ‘that result _in weapon hit 

Ky (easbar of “yes” decisions to attack that) 
are valid opportunities for weapon hit 

= probability of kill given a hit 


, Κις (Number of kills 
Ho ( umber of va attacks whic 
result in weapon hit 


LOWER LEVEL EVALUATION 
(a) PE/D = probability of engagement given detection 


= (1 - Pic) Pett 


where 


Pi: = probability that the destroyer screen irretrievably 
“loses contact on the penetrating submarine 


umber of submarines that successfully penetrate 
because the destroyer screen loses contact 


AT ae Vi 
«. alt « irretrs 
2 ( umb2r of detections that are va engagement) 
opportunities for the destroyer screen 


Pe/It = probability that a screen destroyer maneuvers to a 
position such that an attack decision can be made, 
given that an irretrievable lost contact is not the 
cause of submarine success 


Number of times a screen destroyer 
E, successfully gains position to attack 


.  , \a_penetrator 
cy umber of valid engagement opportunities 
\ upon which contact is not irretrievably 
lost 
(b) PU/AT = probability of hit given attack 

= Pryat Paptyte Puyapt * Patyat PapayaL PH/apA 
Ρ p Ρ 
DATL/AT APATD/DATL © H/APATD 
* Poruyat Paptovote PHyapto 


* Poatyat PapaD/oAL PH/ApAD 
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where 


PrL/AT = probability of single Surface Vessel Torpedo Tube 
(SVTT) launch, given an attack 


(TL) (ee of destroyer screen attacks in ahah) 
] a single SVTT launch is made 


‘ Ao " /Fotal number of destroyer screen attacks 
that are valid opportunities for any ASW 
weapon launch 


P = probability of accurate placement, given single 
APT/TL SVTT launch 


Number of single SVTT launches which ΠΕΡῚ 


" CAPT), Ξ (in accurate placement of weapon 
(TL) umber of single ὃ aunches which are 
2 valid opportunities for accurate weapon 
placement 
= probability of hit, given accurate placement of single 


p 
H/APT SVTT in a single SVTT launch 


Number of accurate placements, in einige 


ΒΞ ὃ (svrt launches, that result in weapon hit 
(APT), umber of accurate placements, in single 
SVTT launches, that are valid opportunities 
for weapon hit 


PAL /AT = probability of single ASROC launch, given an attack 


Number of destroyer screen attacks in which ὃ 


᾿ (AL), Ρ einai ASROC_is launched 
Ky otal number of destroyer screen attacks that 
rts valid opportunities for any ASW weapon 
aunch 


PAPA/AL = dicate of accurate placement, given single ASROC 
(APA) Pedals of single ASROC launches which ἜΠΠ 1 
ἑ 1_ .«Δίη δοουγᾶϊζα placement of Hea pen 
(AL), Number of single AS aunches which are 
valid opportunities for accurate weapon 
placement 
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Pu/APA = probability of hit, given accurate placement of single | 
ASROC in a single ASKOC launch 


(eanber of accurate placements, in single 
. = . ἃ , \ASROC Lagnches. that result in weapon hit) 
(APA), umber of single accurate placements, 
(in single ASROC launches, that are valid 
opportunities for weapon hit 
POTL/AT = probability of dual SVTT launch, given an attack 


᾿ Σ (OTL), = Number of dual launched SVTT attacks 
Ky ( otal number of destroyer screen attacks 


that are valid opportunities for any ASW 
weapon launch 


Ρ 5 probability of accurate placement of at least 
APTD/OTL one SVTT, given dual SVTT launch | 


(APTD) (Rupee: of dual SVTT launches which result my 
H = 1, \accurate placement of at least one weapon 
, (OTLY,, (ee of dual SV aunches which are vali 
opportunities for accurate placement 


Pu /APTD = probability of one hit, given accurate placement of at 
least one of two SVTT's in a dual SVTT launch 


at least one weapon, in a dual SVTT launch, 


Ξ =\resuits in ἃ weapon hit 
(APTD),, umber of times that accurate placement ὁ 
at least one weapon, in a dual SVTT launch, 
is a valid opportunity for a weapon hit 


POAL/AT = probability of dual ASROC launch, given an attack 


(τ λει of times that accurate placement Ἷ 
HTD 


(DAL), ~ Number of dual launched ASROC attacks 
2 ( otal number of destroyer screen attacks 


that are valid opportunities for any 
ASW weapon launch 


‘ PAPAD/DAL = probability of accurate placement of at least one 
of the ASROC's, given dual ASROC launch 


(APAD) eee of dual ASROC launches which result i) 
2 1 , \accurate placement of at least one weapon 
(DAL), a er of dua aunches which are va a) 


pportunities for accurate placement 
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Pu/APAD = probability of one hit, given accurate placement of at 
least one of two ASROC's in a dual ASROC launch 


at least one weapon, in a duai ASROC Jaunch, 


« —HAD = \results in ἃ weapon hit 
(APAD)., (ie er of times that accurate placement o :) 


(sete of times that accurate placement of 


least one weapon, in a dual ASROC launch, is 
a valid opportunity for a weapon hit 
= probability of dual ASROC/SVTT launch, given an attack 
(DATL), 


Ξ = Number of dual ASROC/SVTT launch attacks 
A ( ota! number of destroyer screen any 45 


POATL/AT 


2 that are valid opportunities for any ASW 
weapon launch 


P = probability of accurate placement of at least one of 
APATD/OATL the two weapons (ASROC/SVTT) given dual ASROC/SVTT 
Taunch 


(resi of dual ASROC/SVTT launches which 
result in accurate placement of at least 
(APATO) = \one weapon 

2 (are va of dua aunches whic 


ASROC/S 
are valid opportunities for accurate 
weapon launch 


Pu /APATD = probability of one hit, given accurate placement of 
ον least one of the two weapons in a dual ASROC/SVTT 
aunch 


of at least one weapon, in a dual ASROC 


(rat. of times that accurate ia βίο 
/ 
HATO SVTT_launch, results in a weapon hit 


2 Number of times that accurate placement 
of at least one weapon, in a dual ASROC/ 
SVTT launch, is a valid opportunity for 
a weapon hit 


ASSUMPTIONS: 
(1) A submarine must penetrate the destroyer screen in order to attack 
an HVU. Submarine attacks on HVU from outside the destroyer screen 


(i.e., a cruise missile attack) are not considered. This assumption 
is made because in the SHAREM exercises, which are the major source 
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(2) 


of data for estimating the MOE, the submarine is required to pene- 
trate the destroyer screen in order to gain an attack position on 
an HVU. The attack position is defined in terms of the range to 
the nearest HVU. 


The attacking submarine is said to have successfully penetrated the 
destroyer screen when (1) it has closed the HVU to an attack posi- 
tion or (2) it has reached a position inside the screen such that 
an HVU lies along the bearing line from an attacking destroyer to 
the penetrating submarine. 


(3) Data from astern penetrations should not be aggregated with data 


from ahead penetrations since radiated noise and perturbed water 
conditions astern the screened body make astern penetrations non- 
equivalent to ahead penetrations with similar relative speeds. 


(4) Submarine evasion of the destroyer screen is not considered (i.e., 


(5) 


the submarine either successfully penetrates or is killed). Neither 
the model nor the present SHAREM exercises are designed to evaluate 
the effect of forestalling a submarine penetration. To model the 
effectiveness of forestalling would require a quantitative measure 
of scree. effectiveness as a function of time. The present model 
may serve as a building block for such a more general, al] inclu- 
sive model. If future SHAREM exercises include situations where 
the penetrating submarine evades, such that it is no longer con- 
sidered a penetration threat, a term could be added to the model 
presented herein to account for this. Evasion, so defined, is 
mutually exclusive of both the submarine being killed and the sub- 
marine successfully penetrating the screen. Evasion may occur, 

for example, due to a HVU maneuver based upon screen detection. 


Details (e.g., reattacks) of a destroyer/submarine dogfight are not 
considered. Submarine attacks on destroyers are not considered. 
In the present SHAREM scenario, the above occurrences are rare. 
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If any of the above did occur during a penetration run, however, 
the success or tailure of the destroyer screen in attaining a posi- 
tion to attack (and deciding to attack) the penetrating submarine 
should be included in the data base for evaluating destroyer screen 
effectiveness. 


(6) If the destroyer weapon is not accurately placed, it is assumed 
that the submarine is not hit. A weapon is said to be accurately 
placed if the target falls within the nominal acoustic acquisition 
cone of the enabled weapon. 

(7) If a submarine is initially detected and contact is lost and later 


regained by the same screen destroyer or by another screen destroyer, 
that submarine is considered to be only one screen detection (i.e., 


there can be no more than one screen detection per penetration attempt). 


(8) The destroyer screen is initially semi-alerted. (i.e., destroyer 
screen knows the submarine is in the area byt does not have a 
bearing and/or range estimate. ) 


(9) The probability of screen destroyers prosecuting a non-submarine 
detection (i.e., a false contact) is not explicitly considered 
in this evaluative model; rather, false contacts are considered 
in destroyer performance measures addressed separately. It should 
be realized, however, that prosecuting false contacts could have a 
degrading effect on destroyer screen effectiveness. It may, for 
instance, be the cause of a penetrating submarine not being 
detected. As such, its degrading effect is implicitly reflected 
in this measure. 


(10) The probability of the destroyer screen correctly classifying a 
valid submarine detection is implicitly included in this model 
(i.e., detecting a valid submarine means detecting and classi- 
fying it). 

(11) Only one destroyer will attempt to engage the submarine given that 
the penetrating submarine is detected by the destroyer screen 
({.e., only one-on-one encounters are considered). 
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(12) If a submarine is initially detected and contact is lost and later 
regained by the same screen destroyer or by another screen destroyer, 
that submarine is considered to be only one valid detection, i.e., 
there can be only one screen detection per penetration attempt. 


(13) If a detection is made and contact is lost and never regained due 
to evasion or confusion on the part of the submarine such that 
it fails to close the destroyer screen and pass between screen 
destroyers, that submarine is considered to have been neither a 
valid detection opportunity nor a valid detection. 


(14) A screen detection is a valid opportunity for engagement if the 
destroyer is not artificially prevented from attaining an attack 
position relative to the submarine — for example, a run termina- 
tion prior to engagement. 


(15) A decision to attack is made when the firing order to launch a 
weapon is given; however, for each engagement only one attack 
decision is counted. 


(16) The measure of effectiveness is regarded as an estimate of the 
probability of kill given an opportunity, since it is not necessarily 
equal to the number of kills divided by the number of opportunities. 
The reason for this is that runs are sometimes truncated, that is, 

ἃ success in one phase of an encounter may not be a valid opportunity 
for the next phase due to the exercise run being prematurely 
terminated by the OTC of the exercise. 


(17) If contact is regained by the destroyer screen prior to submarine 
penetration of the screen, the destroyer screen is not considered 
to have irretrievably lost contact. 


(18) A weapon is considered to be accurately placed if the target 
falls within the nominal acoustic acquisition cone of the 
enabled weapon. 
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(19) If a dual launch is attempted but due to fire contro), weapon, 
or personnel] failure only one weapon enters the water, then 
that launch is treated as a single launch. If due to any failure 
no weapons enter the water, then that run is assessed as a failure 
to launch. 


(20) The expanded probability of hit given attack allows for only one 
launch tactic per attack and only one hit per attack. 
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DATA REQUIREMENTS SUMMARY: (1) 


DATA SOURCE WCAPONS TESTS, 
ane ATTACK LABORATORY 


DATA ITEM ΠΣ 
EXERCISES 


(2) 


(3) 


The sample size of data used to estimate each of the conditional 
probabilities need not be equal. This allows maximum use of 
data from different type exercises and also from exercise runs 
which are terminated prior to completion and thus valid for 
estimating only some terms of the model. 


A detection exercise consists of repeated attempts by one 
submarine to penetrate a destroyer screen that is made up 

of two or more destroyers on patrol stations protecting a single 
ship high value unit (HVU). In this type of exercise, the sub- 
marine attempts to penetrate the screen to simulate a penetra- 
tion attempt against a complete destroyer screen. The penetra- 
ting submarine neither attempts to evade the screen nor attacks 
screen destroyers. The submarine mission is ἴ.) reach an attack 
position on a high value unit of the screened body. Simulated 
submarine cruise missile attacks from outside the convoy are not 
included in these exercises. For the purpose of evaluating 
destroyer screen success, eacr non-truncated exercise run results 
in either a successful screen pevetration by the submarine or a 
destroyer screen decision to attack a detected submarine. The 
actual exercise run terminates when either the submarine pene- 
trates the screen, the OTC terminates the run, or after a speci- 
fied period from COMEX, whichever occurs first. Data for the 
model beyond the decision to attack the submarine in an engagement 
is obtained from SHAREM attack exercises and other sources. 


An attack exercise consists of repeated attempts by one submarine 
to penetrate a destroyer's patrol area. The main objective of 

this type of exercise is to evaluate destroyer attack effective- 
ness. For the purpose of providing data for the evaluative model, 
attack exercise runs proceed from the destroyer decision to attack, 
through destroyer weapon launch, to either automatic cutoff (ACO) 
range (i.e., weapons are not set to hit) or weapon miss. The 
destroyer weapons include both deck launched torpedoes and ASROC.) 
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REFERENCE: "Destroyer Analysis Notebook” 
COMDESDEVGRU Technical Report 15-73 
31 Aug. 1973, CONF. 


$S1-2 (Destroyer in Barrier/Search Attack (SAU) Mission) 


DESCRIPTION: A coord‘nated ASW group (including destroyers) attempts 
to locate, intercept, and destroy enemy submarines that are in transit 
to and from their bases and operating areas. 


(1) SPECIFIC OBJECTIVE: Locate, intercept and destroy enemy submarines. 


MOE = Probability of destroying an enemy submarine given 
an opportunity 


= Povo Payo Kya 


where 


= probability of detecting an enemy submarine, 
given an opportunity 


Number of detections 


2 Number of opportunities 


= probability of accurately placed attack, given 
detection of an enemy submarine 


« _Number_ of accurately placed attacks 
Number of detections 


PRIA = probability of proper weapon functioning, given an 
accurately placed attack 


« Number of weapons which functioned properly 
umber of accurately placed attacks 
REFERENCE: "Destroyer Analysis Notebook" 


COMDESDEVGRU Technical Report 15-73 
31 August 1973, CONF. 


Povo 


Pa/D 


SS1-3 (Destroyer in Passive Barrier/Cold War Submarine Hold-Down Mission) 


DESCRIPTION: Contact is maintained, overtly or covertly, with an enemy 
submarine while it is in transit or on-station with the ability to be 
able to localize the submarine with sufficient speed and accuracy when 
required. 
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(1) SPECIFIC OBJECTIVE: Maintain contact sufficiently so as to be able 
to localize when required. 


MOE = Probability of intercepting an unalerted transiting 
enemy submarine 


= Povo Pacyo 


Povo = probability of detecting an unalerted transiting 
enemy submarine using passive sonar (5050 5 or air 
dropped buoys), given an opportunity 


~ Number of passive detections 
umber of opportunities 
= probability of converting a passive sonar contact 


Pac/D 
(SOSUS or air dropped buoys) to an active sonar 
contact 


. _Number_of active contacts 
er of passive detections 
REFERENCE: “Destroyer Analysis Notebook" 


COMDESDEVGRU Technical Report 15-73 
31 August 1973, CONF. 


59] «4 (Destroyer Using Jezebel) 


DESCRIPTION: This ship utilizes an airborne platform (in particular, the 

drone anti-submarine helicopter (Dash)) to drop sonobuoys and <o relay 

the sonic information to the destroyer. This concept provides the destroyer 
with a long range detection and classification capability against a snorkeling- 
diesel submarine. 


(1) SPECIFIC OBJECTIVE: Evaluate detection capability. 


(MOE), = Detection success ratio 
~ Number of detections 


Number of detection opportunities 


(MOE). = Effective sonobuoy detection range 


ASSUMPTION: A detectior opportunity is that period when the 
target submarine is snorkeling. 
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(2) SPECIFIC OBJECTIVE: Evaluate classification capability. 


(MOE), = Classification success ratio 


. Number of targets correctly classified 


ic ale of opportunities for target) 
classification 


(MOE), = Mean time required to classify a target after 
initial contect 


ASSUMPTION: A target classification opportunity is one where 
received signature characteristics from one sonobuoy matched 
the known target signature characteristics. 


REFERENCE: Final Report on Project F/0251 
"Conduct a Fleet Operational Investigation of the Destroyer 
Jezebel Concept" 
3 June 1970, SECRET 
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SS2 


552 - Amphibious Ass '1t Ship (LPH-2) 


DESCRIPTION: This is a LPH-2 Class ship with AV-8A fixed wing VSTOL 
aircraft and SH-3H ASW helicopters. The ship operates helicopters in 
a continuous airborne ASW mission, and VSTOL in a react mode for OL! 
(Deck Launched Intercept) or DLA (Deck Launched Attack) against air or 
surface threats. 


(1) SPECIFIC OBJECTIVE: Evaluate single DLI/DLA reaction against a 
single threat in AAW and ASURW missions. 


(MOE), = Likelihood of interception 


. Number of intercepts 
Number of DLI/DLA attempts 


(MOE) 4 = Average reaction time from detection to 
launch 

(MOE), = Average reaction time from launch to 
intercept 


(2) SPECIFIC OBJECTIVE: Determine the capability to contrul the laying 
of sonobuoy patterns utilizing the SH-3 helicopter. 


(MOE), = Average pattern placement error 
(MOE). = Median pattern placement error 
(3) SPECIFIC OBJECTIVE: Determine system capability for submarine 
localization and tracking using SH-3 relayed Jezebel information. 
(MOE), = Likelihood of an estimated position (EP) 
. Number of estimated pos ie rons obtained 
( umber of Opportunities for pass ) 
localization, given detection 
(MOE). = Mean estimated position error 
(MOE), = Median estimated position error 


(4) SPECIFIC OBJECTIVE: Determine the system capability to lay and main- 
tain a passive sonobuoy barrier at a specified range from the ship 
while maintaining a fixed speed-of-advance (SOA). 
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(MOE), = Mean barrier kingpin drop error 


(MOE). = Mean length error (nm) of achieved sono- 
᾿ buoy line from desired line, assuming king- 
ξ pin drop is accurate 

(MOE), = Mean end-to-end course error (deg) of 


achieved sonobuoy line from desired line, 
i assuming kingpin drop is accurate 


(MOE), = Mean error (nm) in sonobuoy spacing 


(MOE). = Mean deviation of sonobuoys fiom desired 
course (deg) 

(5) SPECIFIC OBJECTIVE: Evaluate system response to a torpedo flaming 
datum or other detection within a specified distance of a task 
force main body. 

(MOE), = Average redetection time, which is the 
average of the elapsed time taken from 
the time of SH-3H arrival at datum to the 
time of the first confirmed active redet- 

ection or MAD 


(MOE), 
(WOE), 


Number of magnetic anomaly detections 


Average redetection time to MAD, which js 
defined as the average period of elapsed 
time from time of redetection to the time 
of the first MAD 


(MOE), = Average number of valid attacks, which is 
defined as the number of attacks evaluated 
by the exercise submarine as "good" or 
"excellent" or, in the absence of a sub- 
marine evaluation of the attack, those 
attacks determined by computer reconstruc- 
tion to be within 1000 yds of the submarine 
position 
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(MOE), = Average redetection to attack time, which 
5 defined as the average period of elapsed 
time from the time of redetection to the 
time of the first valid attack from any 
participating SH-3H 


(MOE), = Likelihood of kill, assuming kill given a 
valid attack is certain 
Number of valid attacks 


" Total number of attack opportunities 


(6) SPECIFIC OBJECTIVE: Determine the accuracy and capability of the system 
to lay a sonobuoy field using VSTOL aircraft. 


(MOE), = Average aircraft track error (deg) 


(MOE), = Average placement error of the first 
sonobuoy 


(MOE), = Average placement error of al] sonobuoys 
dropped 

(MOE), = Average placement error of all sonobuoys 
dropped, after removal of the kingpin error 


(7) SPECIFIC OBJECTIVE: Determine system capability to control the SH-3 
helicopter to a specified sonobuoy drop position. 


(MOE), = Mean buoy drop error in range (nm) 
(MOE), = Mean buoy drop error in bearing (deg) 


REFERENCE: Second Partial Report on Project P/C2 
"Conduct an Operational Appraisal of the Interim Sea Control 


Ship" 
14 Aug. 1973, CONF. 


PLATFORM/SYSTEM/ EQUIPMENT. 


Acoustic countermeasures 


Acoustic intercept receiver 


Acoustic noisemaker 
Aircraft (fixed wing) 


Amphibious assault ship 


Antisubmarine contact 
analysis center 


Automatic permanent 
magnetic compensator 


Avionics system 
Bomb 
cluster 


television guided 


laser guided 

rocket assisted 
Command and contro] system 
Control wire detector 
Data communications set 
Data relay system 
Deception repeater 
Decoy 

electro-acoustic 

infrared 

repeater buoy 
Degaussing system 


AREA 
CODE 
ADCS 
ADC8 
ADC6 
Al 
A2 
A3 
552 


003 


EDCY 
DD4 


01 
02 


03 

06 
002 
EDC4 
(5 
007 
EDC16 


ADC5 
1002 
EDC19 
EDC8 
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TABLE B-3 Platform, System and Equipment Index 


SUBJECT 


SAWS 

AN/WLR-9 

NAE Beacon Mk 3 Mod 1 
F8U-2 

5-26 


LPH-2 Sea Control] Ship 


ASCAC 


ANEW 


CBU-59/B APAM, Mk 15 
Mod 0 SADEYE 


Walleye Mk 1 Mod 0 
Walleye II Mk 5 


A-6A/RABFAC/Paveway 
SUBROC 

DATACOURTS 

L Mk 3X Mod 0 (RADRAG) 
HICAPCOM 


AN/SLQ-17(V) 
NIXIE 


AN/ULQ-5 


PLATFORM/SYSTEM/EQUIPMENT 


Destroyer 


Direction finding system 


Drone control set 
ECM receiving antenna 
Electronic display system 
Electronic warfare system 
Facilities control system 
Fire control system 

bomb 

gun 

missile 


underwater 
Gunpod 
Helicopter 


drone 
IFF system 
Location marker 
MAD device 


Message processing and 
distribution systen 


Mine 
Mine defense system 


Minehunting and surveillance 
system 


Minesweeping equipment 


AREA 
CODE 
55] -Ἰ 
55]-2 
$$1-3 
955] -4 
EDC13 
EDC14 
(6 
EDC12 
005. 
EDCI1 
(7 


TABLE B-3_ Platform, System and Equipment Index (Continued) 


SUBJECT 


AN/SRO-19 (XN-1) 
AN/BRD-7 


AS-899/SLR 


AN/SLQ-27(XN-1) SHORTSTOP 
CVAN 68 (MPDS/FCS) 


Mk 87, Mk 87 Mod 0 
AN/SPG-518 
F-4 AMCS Aero 1A, F-8 AWG-4 


Mk 114 

GPU-2/A, Mk 4 Mod 0 
SH-3A 

SH-3H 

DASH 

AN/SLQ-20, AN/UPX-24 
EX-19, EX-20 
AN/ASQ-8 


Destructor Mk 30 Mod 0 
SHADOWGRAPH 


SEANETTLE 
ROTOVAC 6X, RCTOVAC 7X 
Mk 105 Mod 0, Mk 104 Mod 1 


TABLE B-3 Platform, System and Equipment Index (Continued) 


PLATFORM/SYSTEM/EQUIPMENT 


Missile 
air-to-air 
air-to-surface 
anti-radiation 
rocket-propelled ballistic 
surface-to-air 


Navigation system 
aircraft 
submarine 
surface ship 

Noise jammer 

Radar 
air search 


a‘~ traffic co7tro] 
early warning 
Radio frequency amplifier 
Radio frequency oscillator 
Radio transmitter 
Report receiver-transmitter 
Rocket 
Sonar 
mine detection/classification 
submarine 
surface ship 
towed array 
Sonobuoy 


Sounder receiver system 


AREA 
CODE 


M1 
M3 
M2 
M5 
Μ4.] 
M4-2 


NG4 
NG3 
NG] 
Ε0020 


EDC1-1 


EDC 1-2 
EDC1-3 
EDC18 
EDC15 
(4 
03 
05 


ADC1-4 
ADC1-1 
ADC1-3 
ADC1-2 
ADC2 
ADC3 
C2 
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SUBJECT 


AIM-9C 

AGM-12B Bullpup 
YAGM-45A SHRIKE 

Mk 1 Mod O(TERNE III) 
REDEYE 

STANDARD Missile 


AN/APN-126 

AN/BRN=7 OMEGA Receiver 
OMEGA Receiver 

ALT-27 


AN/SPS-49 (XN-1), 
AN/SPS-50 (XN-1), AN/SPS-52, 
AN/SPS-58 


AN/SPN-43 


AM-4530/ULQ-6A 
0-1331 (XN-1)/ULQ-6 
AN/WRA-3 


ZAP 


AN/SQQ-14, AN/SQQ-16 
AN/BQR-16, AN/BQR-19 
AN/SQQ-23 

AN/BQR-15 

CASS 

AN/SSQ-20, AN/SSQ-1 


PAGE 


B-105 
B-108 
B-106 
B-113 
B-109 
B-110 


B-118 
B-117 
B-115 
B-83 


B-58 
B-59 
B-60 
B-8] 
B-77 
B-37 
B-36 
B-125 


B-18 
B-12 
B-14 
B-13 
B-21 
B-23 
B-35 


TABLE B-3 Platform, System and Equipment Index (Continued) 


PLATFORM/SYSTEM/EQUIPMENT 
Submarine 


Submarine classification and 
tracking device 


TACAN 
Tactical data system 
Target recognition set 


Teletype integrated display 
system 


Torpedo 
active/passive 
rocket assisted 
wire-guided 

UHF transceiver 

Wake detector 

Warning receiver 


AREA 
CODE SUBJECT 
Sl-1 
$1-2 
S1-3 


ADCS = SCAT 

NG2 AN/URN-20 

001 NTOS 

EDC3  AN/ASX-2 (TRISAT) 


006 TIOY 


08-3 Mk 46 Mod 1 


08-2  ASROC 

08-1 Mk 48 Mod 1 
ΟἹ AN/WSC -3 
100] 


Ε005 ΑΝ ΝΗ. Ά.-8(ν)2 
EDC17 
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PAGE 


B-139 
B-142 
B-146 


B-25 
B-116 
B-43 
B-63 


B-52 


B-134 
B-133 
B-13) 
B-33 
B-100 
B-65 
B-80 


TABLE B-4 Project Index 


FC3 
ADC4 
EDC1-1 


EDCI5 
ADC7 
FC2 
EDC1-1 
FC4-1 
FC2 


FC4-3 
Μ4-2 


SUBJECT 


Mk 46 Mod 1 
AS-899/SLR 
ASROC 
NTOS 


AN/SQQ-14 

SUBROC 

DASH 

HICAPCOM 

OMEGA Receiver 

Mk 1 Mod 0 (TERNE IIT) 
Mk 114 

SCAT 


AN/SPS-49 ee ’ 
AN/SPS-50 (XN-1 


0-133] (XN-1)/ULQ-6 
ROTOVAC 6X, ROTOVAC 7X 
Mk 86 Mod 0 

AN/SPS-52 

AN/SPG-51B 

Mk 87 
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PAGE 


8.134 
B-74 
B-133 
B-43 
B-78 
B-68 
B-18 
B-126 
B-10 
B-38 
B-115 
B-113 
B-90 
B-25 


8-58 
B-77 
8-28 
B-88 
B-58 
B-92 
B-88 


B-96 
B-110 


TABLE B-4 Project Index (Continued) 


AREA 


PROJECT _CODE_ SUBJECT PAGE 
C/S52 E0C18 AM-4530/ULQ-6A B-81 
C/S56 ADC1-1 AN/BQR-16 B-12 
(559 Α00]-2 AN/BQR-15 B-13 
C/S61 AOC} -1 AN/BQR-19 B-12 
C/S63 ADC5 NIXIE B-26 
C/S68 002 DATACOURTS B-44 
C/S70 EDC16 AN/SLQ-17(V) B-78 
(7571 Α008 AN/WLR-9 B-29 
(7572 ΕΡ(Ί -Ἱ AN/SPS-58 B-58 
C/S82 EDC2 AN/UPX-24 B-62 
C/S85 ADC9 SAWS B-30 
0,594 Ε0Ὸ5 AN/WLR-8(V)2 B-65 
ΟΊ ΜΙ AIM-9C B-105 
C/V2 ADC3 B-23 
C/V9 M2 YAGM-45 SHRIKE B-106 
C/V10 ADC4 SCAT B-25 
C/V14 09 Destructor Mk 30 Mod 0 B-136 
C/V22 EDC1-3 8-60 
F/096 E0C7 SHADOWGRAPH B-67 
F/0116 D07 8-54 
F/0117 003 ASCAC B-48 
F/0134 1003 _EX19, EX20 B-103 
F/0143 1001 8-100 


B-174 


PROJECT 


F/0145 
F/0148 
F/0151 
F/0186 
F/0198 
F/0210 


F/0214 
F/0228 
F/0237 
F/0251 
F/0255 
F/0257 
F/0263 
0/S66 

0597 

075107 
075108 
0/$123 
0/S$126 
0/$138 
075145 
0/S150 


TABLE 8-4 


AREA 
CODE 


EDC19 


ADC6 


07 
EDC1-2 
M4-1 
M4-2 
Μ4-Ἰ 
EDC14 


Project Index (Continued) 


SUBJECT 


AN/ULQ-5 


AGM-12B8 Bullpup 
F-4 AMCS Aero 1A, F-8 AWG-4 


ALT-27 
SH-3A 
ANEW 


A-6A/RABFAC/Paveway 
Walleye II Mk 5 
AN/WRA-3 

NAE Beacon Mk 3 Mod 1 


SEANETTLE 
AN/SPN-43 

REDEYE 

STANDARD Missile 
REDEYE 

AN/BRD-7 


B-175 


PAGE 


B-82 
B-36 
B-69 
B-108 
B-92 


B-80 
B-83 


B-8 
B-49 
B-96 
B-163 
B-6 
B-123 
B-122 
B-37 
B-27 
B-35 
B-129 
B-59 
B-109 
B-110 
B-109 
B-76 


PROJECT 


0/S153 
0/S155 
0/$163 
0/S165 
0/S167 
0/S170 


0/S178 
0/S179 
0/$18] 


0/200 

0/28 
0/V¥28E08 
0/V37 

0/V42 

0/V52 

6/V7) 

0/V84 

0/V86 

0/V95 

0/V98 
OP/S480/S67 
OP/V126/J15-6 
OP/V218/J15-11 
OP/¥261/H 


TABLE 8-4 


AREA 


CODE 


ADC1-4 
NG2 
EOC?) 
1002 
08-1 
NG3 


EOC4 
006 
Cl 


EDC13 
01 
FC} 
04 


005 
EDC10 
ADC3 
NG4 


Project Index (Continued) 


SUBJECT 


AN/SQQ-16 
AN/URN-20 
AN/SLQ-27(XN-1) SHORTSTOP 


Mk 48 Mod 1 
AN/BRN-7 OMEGA Receiver 


L Mk 3X Mod 0 Locator (RADRAG) 


TIDY 

AN/WSC-3 
AN/SRD-19(XN-1 ) 

Mk 15 Mod 0 SADEYE 


Mk 4 Mod 0 

AN/SSQ-1 

Walleye Mk 1 Mod 0 

Mk 105 Mod 0, Mk 104 Mod 1 
CASS 

ZAP 

GPU-2/A . 

CBU-59/B APAM 


AN/ASQ-8 
AN/SSQ-20 


AN/APN-126 


B-176 


5 f ‘ TABLE 8-4 Project Index (Continued) 


i AREA 

j PROJECT. «CODE, «= =__SUBJECT. ΣῪΠΟὩΡΆΕ 

: oP/V264/VV ΑἹ FaU-2 B-3 
P/C2 552 LPH-2 Sea Control Ship 8-166 

Ρ)5] ADC1-3 AN/SQQ-23 Be14 
P/S3 EDC2 AN/SLQ-20 B-62 

: P/V3 ΑΖ $-26 ἡ 

Ϊ P/v4 A4-2 SH-3H B-9 
X/C8 (6 8-39 
X/S7 (7 CVAN 68 (MPDS/FCS) B-40 
X/VI7 EDC3 AN/ASX-2 (TRISAT) B-63 


B-177 


